-- Logs begin at Wed 2021-11-03 01:07:48 UTC, end at Wed 2021-11-03 02:20:56 UTC. -- Nov 03 01:52:51.777771 dv-cinder-815614-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 03 01:52:51.787338 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 3 01:52:51 2021] *** Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: nodename: dv-cinder-815614-3-iscsi Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: machine: x86_64 Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: clock source: unix Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: pcre jit disabled Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: detected number of CPU cores: 4 Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: current working directory: / Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: detected binary path: /usr/bin/uwsgi-core Nov 03 01:52:51.789312 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: your processes number limit is 47680 Nov 03 01:52:51.789995 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: your memory page size is 4096 bytes Nov 03 01:52:51.789995 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: detected max file descriptor number: 2048 Nov 03 01:52:51.789995 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: lock engine: pthread robust mutexes Nov 03 01:52:51.789995 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: thunder lock: enabled Nov 03 01:52:51.789995 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 03 01:52:51.789995 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 03 01:52:51.834116 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: Python main interpreter initialized at 0x56475ee289c0 Nov 03 01:52:51.834116 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: python threads support enabled Nov 03 01:52:51.834116 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: your server socket listen backlog is limited to 100 connections Nov 03 01:52:51.834116 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: your mercy for graceful operations on workers is 90 seconds Nov 03 01:52:51.834478 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: mapped 403077 bytes (393 KB) for 2 cores Nov 03 01:52:51.834478 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: *** Operational MODE: preforking *** Nov 03 01:52:51.834747 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: *** uWSGI is running in multiple interpreter mode *** Nov 03 01:52:51.834747 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: spawned uWSGI master process (pid: 107620) Nov 03 01:52:51.834947 dv-cinder-815614-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 03 01:52:51.838250 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: spawned uWSGI worker 1 (pid: 107621, cores: 1) Nov 03 01:52:51.838250 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: spawned uWSGI worker 2 (pid: 107622, cores: 1) Nov 03 01:52:51.838250 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 03 01:52:53.483249 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 01:52:53.483249 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: from cryptography.utils import int_from_bytes Nov 03 01:52:53.483922 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 01:52:53.483922 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: from cryptography.utils import int_from_bytes Nov 03 01:52:53.484353 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 01:52:53.484353 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: from cryptography.utils import int_from_bytes Nov 03 01:52:53.484482 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 01:52:53.484482 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: from cryptography.utils import int_from_bytes Nov 03 01:52:56.067330 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 01:52:56.068000 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 01:52:56.068109 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 01:52:56.068374 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 01:52:56.068629 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 01:52:56.069010 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.069195 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 01:52:56.069552 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.069641 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 01:52:56.069735 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.069899 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 01:52:56.069996 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.070278 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.070381 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 01:52:56.070533 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 01:52:56.070628 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.070892 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.070978 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.071208 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.071307 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.071533 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.071644 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.071786 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.071892 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.072093 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.072194 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.072414 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-3-iscsi {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.072508 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.072731 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.072824 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073035 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073129 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073343 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073436 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073632 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073768 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.073937 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.074038 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.074281 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.074384 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-3-iscsi {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.074588 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.074689 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.074892 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.075079 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.075196 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076182 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076279 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076364 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076442 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076442 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076574 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076574 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076699 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076699 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.076995 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077095 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077244 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077336 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077485 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077601 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077809 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.077923 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.078125 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.078251 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.078458 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.079179 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-3-iscsi {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.079323 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.079505 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.079644 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.079817 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.079954 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.080131 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.080274 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.080552 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.080657 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.080850 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.080964 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-3-iscsi {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.081155 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.081281 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.081474 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.081591 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.081805 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.081917 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.082111 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.082329 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.082459 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.082639 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.082775 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.082946 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.083090 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.083268 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.083406 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.083599 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.083743 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.083907 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084001 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084232 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084325 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084551 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084646 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084867 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.084961 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.085422 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.085511 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.085672 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.085760 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.085977 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.086118 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.086332 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.086420 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.086649 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.086739 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.086956 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087056 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087202 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087302 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087447 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087551 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087761 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.087850 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088079 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088180 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088385 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088473 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088691 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088786 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.088942 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089030 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089197 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089292 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089514 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089603 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089833 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.089923 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.090170 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.090276 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.090468 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.090568 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.090777 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.090878 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.091084 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.091172 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.091391 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.091488 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.091694 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.091782 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092002 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092121 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092307 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092413 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092623 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092724 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.092926 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093020 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093244 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093347 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093551 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093646 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093855 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.093955 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.094215 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.094324 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.094528 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.094621 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.094835 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.094933 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.095141 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.095237 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.095447 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.095534 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.095766 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.095859 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096083 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096179 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096389 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096481 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096637 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096739 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.096950 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097049 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097241 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097354 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097556 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097653 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097858 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.097946 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.098182 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.098289 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.098458 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.098544 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.098760 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.098860 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099064 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099160 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099376 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099471 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099680 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099766 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.099981 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100072 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100284 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100378 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100583 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100671 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100885 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.100970 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.101188 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.101288 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.101489 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.101582 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.101794 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.101885 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.102102 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.102228 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.102427 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.102514 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.102726 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.102812 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103028 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103120 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103330 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103422 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103642 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103729 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.103941 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104034 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104246 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104333 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104548 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104644 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104853 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.104940 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.105152 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.105244 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.105466 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.105551 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.105768 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.105862 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.106070 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.106187 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.106409 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.106498 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.106707 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.106795 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107012 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107116 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107314 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107405 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107616 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107702 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.107916 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108002 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108217 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108303 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108517 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108611 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108817 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.108908 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.109114 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.109209 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.109419 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.109506 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.109719 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.109839 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110039 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110152 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110361 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110447 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110662 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110756 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.110964 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111063 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111266 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111352 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111563 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111656 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111860 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.111955 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.112175 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.112279 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.112491 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.112578 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.112798 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.112897 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.113102 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.113189 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.113405 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.113491 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.113721 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 01:52:56.113815 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.114054 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.114169 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.114389 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.114485 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.114703 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.114792 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115028 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115115 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115339 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115426 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115648 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115736 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.115957 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116050 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116270 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116367 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116583 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116676 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116907 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.116993 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.117217 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.117322 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.117525 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.117612 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.117835 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.117942 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.118157 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.118258 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.118472 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.118559 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.118796 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.118888 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.119114 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.119213 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.119427 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.119520 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.119744 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.119831 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.120056 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.120157 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.120373 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.120467 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.120693 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.120785 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121004 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121100 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121313 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121405 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121621 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121707 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.121931 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.122026 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.122264 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.122407 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.122591 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.122720 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.122902 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123034 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123213 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123340 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123524 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123655 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123835 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.123962 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.124146 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.124274 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.124449 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.124580 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.124778 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.124903 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.125046 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.125179 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.125353 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.125995 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.126223 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.126355 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.126542 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.126668 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.126849 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.126986 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.127154 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.127328 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.127455 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.127578 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.127754 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.127889 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128058 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128192 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128376 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128509 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128677 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128811 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.128988 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.129114 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.129299 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.129424 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.129605 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.129738 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.129917 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130050 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130249 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130376 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130555 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130688 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130866 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.130999 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.131167 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.131291 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.131468 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.131594 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.131780 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.131911 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132086 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132217 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132426 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132551 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132672 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132791 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.132988 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.133121 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.133292 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.133429 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.133599 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.133731 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.133905 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.134038 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.134239 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.134376 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.134552 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.134679 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.134872 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135010 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135181 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135306 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135491 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135616 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135795 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.135929 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.136103 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.136229 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.136405 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.136538 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.136707 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.136843 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137008 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137148 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137315 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137433 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137615 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137748 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.137917 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138043 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138239 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138365 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138540 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138672 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138839 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.138968 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.139151 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.139275 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.139453 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.139580 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.139750 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.139881 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140050 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140181 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140337 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140464 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140640 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140766 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.140959 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.142742 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.142742 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.142981 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143105 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143228 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143350 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143482 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143605 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143734 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143857 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.143979 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144101 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144233 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144356 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144484 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144615 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144744 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144744 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.144990 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145118 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145243 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145364 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145486 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145616 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145742 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145864 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.145992 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146121 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146266 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146401 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146532 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146654 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146776 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.146905 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147027 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147162 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147293 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147415 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147527 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147646 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147774 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.147905 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148027 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148191 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148318 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148505 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148637 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148806 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.148932 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.149115 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.149240 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.149421 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.149560 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.149730 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.149856 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150043 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150201 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150372 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150513 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150686 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150813 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.150992 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.151124 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.151299 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.151435 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.151604 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.151738 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.151912 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152038 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152217 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152350 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152531 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152666 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152862 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.152988 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.153118 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.153248 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.153437 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.153562 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.153760 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.153885 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154083 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154232 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154387 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154515 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154690 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154826 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.154996 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.155122 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.155303 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.155430 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.155611 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.155739 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.155914 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156042 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156216 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156349 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156523 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156681 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156855 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.156980 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.157166 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.157291 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.157477 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.157612 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.157781 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.157909 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.158087 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.158238 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.158420 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.158558 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.158735 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.158868 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159042 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159168 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159350 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159482 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159655 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159787 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.159966 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.160091 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.160275 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.160402 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.160579 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.160705 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.160880 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161012 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161183 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161316 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161501 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161625 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161805 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.161930 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.162109 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.162272 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.162436 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.162557 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.162739 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.162870 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163057 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163172 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163350 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163463 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163655 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163795 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.163960 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.164089 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.164265 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.164398 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.164569 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.164702 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.164880 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165013 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165189 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165315 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165492 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165624 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165805 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.165929 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.166119 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.166270 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.166479 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.166645 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.166771 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.166904 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167034 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167157 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167339 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167479 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167647 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167766 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.167956 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168081 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168264 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168387 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168554 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168679 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168862 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.168992 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.169160 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.169285 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.169466 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.169597 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.169778 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.169903 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.170084 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.170369 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.170496 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.170706 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.170833 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171013 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171156 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171321 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171448 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171636 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171760 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.171950 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.172193 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.172345 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.172550 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.172674 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.172867 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173000 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173249 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173380 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173511 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173640 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173793 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.173928 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.174098 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.174252 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.174432 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.174559 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.174739 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.174866 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175045 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175179 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175349 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175475 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175655 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175786 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.175957 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176081 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176260 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176385 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176561 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176692 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176855 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.176990 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.177161 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.177297 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.177470 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.177606 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.177774 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.177905 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.178076 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.178219 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.178420 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.178567 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.178724 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.178859 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179025 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179167 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179329 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179455 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179632 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179752 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.179934 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.180059 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.180257 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.180382 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.180595 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.180757 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.180883 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181013 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181150 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181285 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181446 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181573 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181791 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.181919 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.182100 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.182320 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.182445 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.182567 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.182714 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.182840 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183014 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183149 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183351 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183478 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183600 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183722 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.183902 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184038 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184209 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184336 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184518 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184646 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184826 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.184954 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.185132 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.185258 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.185432 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.185559 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.185731 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.185863 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186031 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186270 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186409 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186543 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186676 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186807 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.186930 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.187059 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.187224 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.187352 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.187531 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.187666 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.187832 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.188452 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.188641 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.188779 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.188948 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189075 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189249 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189376 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189550 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189687 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189848 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.189973 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.190168 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.190300 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.190474 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.190609 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.190783 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.190908 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191086 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191211 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191386 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191522 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191689 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191814 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.191993 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.192119 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.192292 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.192431 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.192591 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.192723 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.192897 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193024 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193196 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193338 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193534 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193667 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193798 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.193921 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.194089 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.194230 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.194414 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.194541 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.194718 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.194851 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195021 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195153 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195319 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195450 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195622 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195748 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.195924 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196051 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196231 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196358 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196531 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196666 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196831 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.196970 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.197184 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.197321 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.197446 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.197575 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.197701 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.197824 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198005 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198188 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198328 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198465 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198624 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198752 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.198925 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199057 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199227 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199362 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199528 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199660 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199848 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.199974 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.200156 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.200290 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.200460 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.200587 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.200765 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.200892 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201067 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201195 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201380 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201505 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201689 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201816 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.201998 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.202125 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.202324 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.202451 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.202635 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.202771 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.202942 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.203070 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.203250 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.203377 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.203594 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.204268 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.204417 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.204552 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.204718 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.204842 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205030 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205164 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205336 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205461 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205647 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205774 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.205952 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.206087 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.206280 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.206407 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.206580 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.206706 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.206905 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207105 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207231 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207353 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207475 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207597 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207765 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.207892 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208072 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208199 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208377 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208505 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208685 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208812 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.208992 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.209119 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.209299 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.209424 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.209603 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.209729 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.209909 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.210299 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.210488 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.210613 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.210796 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.210925 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.211098 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.211224 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.211408 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.211546 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.211709 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.211842 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212011 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212137 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212316 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212449 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212617 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212743 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.212919 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213044 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213219 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213354 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213537 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213683 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213870 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.213996 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.214189 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.214334 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.214460 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.214589 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.214762 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.214894 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.215066 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.215194 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.215438 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.215593 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.215748 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.215874 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216049 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216183 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216374 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216500 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216684 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216810 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.216995 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.217122 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.217309 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.217435 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.217621 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.217748 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.217921 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.218046 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.218250 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.218389 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.218574 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.218709 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.218878 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219005 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219204 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219333 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219509 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219645 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219830 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.219957 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.220136 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.220262 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.220452 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.220587 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.220753 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.220877 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221056 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221183 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221361 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221495 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221682 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221841 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.221989 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.222164 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.222336 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.222464 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.222752 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.222879 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.223063 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.223190 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.223369 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.223496 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.223681 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.223806 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224008 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224141 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224273 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224401 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224585 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224717 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.224906 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225032 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225214 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225341 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225524 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225657 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225826 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.225966 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.226151 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.226281 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.226480 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.226606 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.226788 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.226925 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.227098 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.227222 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.227411 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.227539 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.227717 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.227852 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.228037 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.228165 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.228357 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.228483 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.228670 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.228888 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229026 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229162 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229286 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229407 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229585 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229712 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.229893 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230033 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230227 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230356 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230548 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230675 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230850 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.230979 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.231157 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.231292 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.231465 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.231591 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.231772 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.231900 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232073 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232199 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232372 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232505 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232677 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232802 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.232975 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.233100 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.233281 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.233406 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.233588 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.233714 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.233889 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234028 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234266 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234412 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234538 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234659 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234820 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.234947 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.235137 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.235277 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.235438 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.235566 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.235740 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.235873 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236041 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236176 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236344 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236470 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236663 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236791 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.236972 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.237107 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.237276 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.237402 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.237579 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.237713 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.237880 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238007 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238240 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238370 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238549 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238684 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238860 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.238986 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.239174 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.239301 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.239495 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.239622 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.239798 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.239932 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.240102 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.240235 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.240411 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.240539 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.240715 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.240848 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241018 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241144 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241320 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241454 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241627 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241755 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.241927 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242054 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242253 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242395 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242556 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242689 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242861 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.242993 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.243163 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.243297 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.243470 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.243595 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.243774 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.243909 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244075 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244223 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244411 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244536 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244659 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244780 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.244970 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.245096 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.245278 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.245410 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.245586 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.245717 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.245914 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.246040 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.246230 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.246358 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.246558 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.246695 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.246867 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247002 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247189 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247340 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247500 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247626 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247814 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.247950 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.248126 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.248253 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.248439 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.248578 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.248748 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.248873 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249057 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249182 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249369 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249506 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249677 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249812 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.249989 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.250117 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.250389 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251018 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251151 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251275 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251462 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251664 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251792 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.251990 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.252119 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.252303 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.252431 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.252614 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.252750 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.252924 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.253050 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.253238 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.253492 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.253620 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.253821 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.253949 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.254154 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.254297 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.254472 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.254597 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.254781 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.254884 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.255093 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.255199 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.255408 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.255512 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.255721 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.255820 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256034 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256156 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256347 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256459 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256658 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256754 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.256971 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.257069 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.257283 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.257395 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.257606 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.257706 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.257937 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258034 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258274 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258379 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258586 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258674 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258899 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.258988 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.259210 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.259310 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.259517 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.259616 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.259831 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.259933 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.260144 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.260241 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.260455 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.260550 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.260762 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.260859 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261072 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261173 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261378 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261465 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261685 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261782 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.261995 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.262083 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.262332 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.262423 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.262644 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.262743 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.262952 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.263040 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.263263 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.263356 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.263573 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.263663 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.263893 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.264090 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.264224 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.264409 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.264547 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.264745 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.264863 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.265070 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.265179 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.265396 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.265485 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.265714 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.266048 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.266696 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.266920 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267019 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267226 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267314 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267536 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267631 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267850 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.267947 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.268160 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.268267 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.268468 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.268573 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.268787 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.268885 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.269100 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.269190 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.269409 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.269507 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.269721 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.269817 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.270032 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.270128 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.270365 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.270580 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.270686 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.270928 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271017 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271245 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271335 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271572 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271671 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271881 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.271975 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.272200 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.272412 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.272501 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.272757 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.272847 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.273078 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.273167 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.273390 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.273486 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.273704 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.273838 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274014 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274103 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274341 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274443 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274646 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274789 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.274958 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275046 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275264 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275362 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275567 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275657 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275875 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.275964 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.276178 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.276344 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.276484 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.276573 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.276789 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.276876 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.277094 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.277183 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.277395 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.277491 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.277703 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.277790 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278006 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278100 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278333 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278424 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278638 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278726 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.278939 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279027 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279246 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279340 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279547 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279646 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279853 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.279948 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.280153 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.280240 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.280458 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.280554 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.280757 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.280845 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281063 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281159 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281363 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281460 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281693 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281786 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.281999 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.282086 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.282332 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.282431 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.282635 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.282723 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.282941 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283035 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283243 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283340 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283558 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283645 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283860 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.283947 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.284164 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.284253 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.284479 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.284567 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.284790 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.285016 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.285113 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.285394 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.285483 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.285710 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.285798 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.286050 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.286199 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.286386 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.286474 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.286707 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.286925 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.287013 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.287304 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.287399 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.287624 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.287713 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.287934 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288035 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288243 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288332 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288551 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288648 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288858 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.288958 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.289167 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.289259 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.289474 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.289580 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.289783 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.289892 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.290092 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.290198 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.290428 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.290517 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.290741 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.290831 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291054 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291143 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291368 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291456 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291681 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291770 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.291991 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292080 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292295 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292382 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292603 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292692 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292908 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.292997 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.293214 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.293305 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.293526 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.293616 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.293843 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.293936 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.294191 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.294297 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.294478 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.294565 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.294788 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.294899 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.295099 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.295210 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.295417 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.295515 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.295745 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.295842 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.296059 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.296161 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.296363 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.296456 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.296703 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.296794 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297015 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297110 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297360 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297457 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297671 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297759 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.297997 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.298087 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.298361 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.298453 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.298688 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.298782 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299009 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299104 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299311 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299402 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299614 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299711 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.299923 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300022 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300228 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300317 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300556 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300653 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300866 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.300954 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.301184 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.301272 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.301486 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.301581 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.301793 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.301881 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.302095 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.302229 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.302437 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.302528 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.302753 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.302841 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303062 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303157 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303369 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303459 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303690 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303783 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.303996 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.304089 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.304305 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.304395 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.304614 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.304704 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.304922 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305010 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305230 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305319 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305533 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305621 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305854 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.305954 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.306183 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.306274 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.306498 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.306586 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.306811 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.306911 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.307120 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.307208 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.307429 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.307519 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.307740 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.307836 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308047 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308136 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308356 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308443 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308666 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308754 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.308976 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.309064 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.309282 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.309377 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.309588 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.309716 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.309896 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310037 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310231 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310337 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310558 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310653 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310879 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.310971 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.311198 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.311291 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.311529 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.311622 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.311827 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.311920 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.312143 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.312245 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.312470 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.312562 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.312791 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.313384 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.313554 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 01:52:56.313666 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.313947 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.314320 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.314638 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.314983 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.315310 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 01:52:56.315561 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 01:52:56.336584 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_db.sqlalchemy.engines [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.337792 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_db.sqlalchemy.engines [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.508439 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.context [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8df2cde-dfb3-4296-bec6-9291d21b17e1(cell1) {{(pid=107621) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 01:52:56.509719 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.context [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8df2cde-dfb3-4296-bec6-9291d21b17e1(cell1) {{(pid=107622) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 01:52:56.512864 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:52:56.514218 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_concurrency.lockutils [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:52:56.514457 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:52:56.515276 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:52:56.515804 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_concurrency.lockutils [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:52:56.516641 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_concurrency.lockutils [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:52:56.517222 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:52:56.518581 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_concurrency.lockutils [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:52:56.527723 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_db.sqlalchemy.engines [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.530203 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_db.sqlalchemy.engines [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.532777 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_db.sqlalchemy.engines [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.534784 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_db.sqlalchemy.engines [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.790125 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG oslo_db.sqlalchemy.engines [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:56.792890 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_db.sqlalchemy.engines [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 01:52:57.216483 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: WARNING keystonemiddleware.auth_token [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 01:52:57.223505 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: WARNING keystonemiddleware.auth_token [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 01:52:57.272554 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: WARNING keystonemiddleware.auth_token [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 01:52:57.279151 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: WARNING keystonemiddleware.auth_token [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 01:52:57.569338 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: WARNING keystonemiddleware.auth_token [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 01:52:57.574511 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: WARNING keystonemiddleware.auth_token [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 01:52:57.580726 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56475ee289c0 pid: 107622 (default app) Nov 03 01:52:57.582819 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:52:57.583998 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Nov 03 01:52:57.584418 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Wed Nov 3 01:52:57 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:52:57.623797 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: WARNING keystonemiddleware.auth_token [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 01:52:57.629484 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: WARNING keystonemiddleware.auth_token [None req-8ed5a8ac-dd63-40b3-91d5-617dd9b88363 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 01:52:57.635650 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56475ee289c0 pid: 107621 (default app) Nov 03 01:54:20.411064 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:20.412064 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 03 01:54:20.412472 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:20.843179 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-4ee63528-7a1a-4c0f-b502-f6b907a4ec75 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:20.873862 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-4ee63528-7a1a-4c0f-b502-f6b907a4ec75 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.453595 Nov 03 01:54:20.878192 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Nov 3 01:54:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:23.197621 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:23.198667 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-47243a6d-f9a4-4865-959c-dac498244afc None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 03 01:54:23.199084 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:23.260235 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a495c093-9cc0-406f-8f3f-3380060c7230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:23.278802 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 01:54:23.278802 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: warnings.warn(msg) Nov 03 01:54:23.357281 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-a495c093-9cc0-406f-8f3f-3380060c7230 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.151468 Nov 03 01:54:23.358479 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:23 2021] POST /compute/v2.1/flavors => generated 407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:23.592712 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-c1447c8e-a276-4257-b006-b14f1cfd55a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:23.596290 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 01:54:23.596290 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: warnings.warn(msg) Nov 03 01:54:23.719903 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-c1447c8e-a276-4257-b006-b14f1cfd55a6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352583 Nov 03 01:54:23.720752 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Nov 3 01:54:23 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:26.001292 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a495c093-9cc0-406f-8f3f-3380060c7230 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:26.002346 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-a495c093-9cc0-406f-8f3f-3380060c7230 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 03 01:54:26.002778 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:26.124414 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-d468583b-57e2-4c04-a169-be438c0a756d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:26.145104 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 01:54:26.145104 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: warnings.warn(msg) Nov 03 01:54:26.245011 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-d468583b-57e2-4c04-a169-be438c0a756d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.235357 Nov 03 01:54:26.245964 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:26.259880 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-aca08e4e-9b45-40d1-b1c8-e91b47ed8438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:26.261492 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 01:54:26.261492 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: warnings.warn(msg) Nov 03 01:54:26.362509 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-aca08e4e-9b45-40d1-b1c8-e91b47ed8438 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107639 Nov 03 01:54:26.366263 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Nov 3 01:54:26 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:28.661942 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-d468583b-57e2-4c04-a169-be438c0a756d admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:28.662972 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-d468583b-57e2-4c04-a169-be438c0a756d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 03 01:54:28.663369 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:28.724871 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a6c91017-3bfa-42d8-ab89-4d81612fc815 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:28.802831 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-a6c91017-3bfa-42d8-ab89-4d81612fc815 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132992 Nov 03 01:54:28.804114 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 01:54:28.816316 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-fdaae549-9766-41cc-9c3d-83f2028a0121 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:28.902401 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-fdaae549-9766-41cc-9c3d-83f2028a0121 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089757 Nov 03 01:54:28.903732 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Nov 3 01:54:28 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 01:54:31.179377 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a6c91017-3bfa-42d8-ab89-4d81612fc815 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:31.180380 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-a6c91017-3bfa-42d8-ab89-4d81612fc815 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 03 01:54:31.180778 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:31.242822 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-36eb1607-36ba-4d07-b8f4-f13c800d5cbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "disk": 10}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:31.352492 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-36eb1607-36ba-4d07-b8f4-f13c800d5cbe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164675 Nov 03 01:54:31.353048 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:31.366037 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-fbf1087a-1f2d-41a3-8a40-31ed0dca8939 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:31.451025 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-fbf1087a-1f2d-41a3-8a40-31ed0dca8939 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088647 Nov 03 01:54:31.451520 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Nov 3 01:54:31 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:33.740326 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-36eb1607-36ba-4d07-b8f4-f13c800d5cbe admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:33.741335 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-36eb1607-36ba-4d07-b8f4-f13c800d5cbe admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 03 01:54:33.741741 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:33.806578 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-031e8c9b-f5e3-4eae-9c4c-17dbc9f17be1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4"}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:33.912859 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-031e8c9b-f5e3-4eae-9c4c-17dbc9f17be1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164061 Nov 03 01:54:33.913397 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:33.926278 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-e01eab39-519d-4148-a734-18b77e2b1123 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:33.985518 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-e01eab39-519d-4148-a734-18b77e2b1123 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062597 Nov 03 01:54:34.006228 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Nov 3 01:54:33 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 01:54:36.277320 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-031e8c9b-f5e3-4eae-9c4c-17dbc9f17be1 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:36.278367 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-031e8c9b-f5e3-4eae-9c4c-17dbc9f17be1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 03 01:54:36.278773 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:36.341710 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-16a1ac8a-073a-4df9-86db-19f4326fc9c7 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:36.375934 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-16a1ac8a-073a-4df9-86db-19f4326fc9c7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090293 Nov 03 01:54:36.376717 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Nov 3 01:54:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:54:38.679470 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-031e8c9b-f5e3-4eae-9c4c-17dbc9f17be1 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:38.681699 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-031e8c9b-f5e3-4eae-9c4c-17dbc9f17be1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003082 Nov 03 01:54:38.682506 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:38 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 01:54:38.757959 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-3a003dbd-264b-42a8-b894-26133f4609a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:38.842668 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-3a003dbd-264b-42a8-b894-26133f4609a1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.148746 Nov 03 01:54:38.843150 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:38 2021] POST /compute/v2.1/flavors => generated 402 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:38.856146 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-8547e0f5-aea1-46a8-92d2-8a51c7ec0d52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:38.959813 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-8547e0f5-aea1-46a8-92d2-8a51c7ec0d52 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107933 Nov 03 01:54:38.960409 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Nov 3 01:54:38 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:41.400117 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-3a003dbd-264b-42a8-b894-26133f4609a1 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:41.401137 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-3a003dbd-264b-42a8-b894-26133f4609a1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Nov 03 01:54:41.401585 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:41.463718 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-8987f38b-ee7e-4a5e-97ea-7233e1f01b46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:41.547489 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-8987f38b-ee7e-4a5e-97ea-7233e1f01b46 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.138941 Nov 03 01:54:41.547980 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 01:54:41.562985 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-17731f4e-2ef1-4387-bd90-3e9e392ba32f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:41.652953 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-17731f4e-2ef1-4387-bd90-3e9e392ba32f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094175 Nov 03 01:54:41.653541 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Nov 3 01:54:41 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:44.168006 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-8987f38b-ee7e-4a5e-97ea-7233e1f01b46 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:44.169055 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-8987f38b-ee7e-4a5e-97ea-7233e1f01b46 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Nov 03 01:54:44.169474 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:44.235558 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-305094ad-8daa-42ae-867f-4e98aecbe685 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:44.310005 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-305094ad-8daa-42ae-867f-4e98aecbe685 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133606 Nov 03 01:54:44.310772 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:44 2021] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 01:54:44.322694 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-345812f6-00f6-4fc2-90e3-4aca9d1a5ec4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:44.428011 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-345812f6-00f6-4fc2-90e3-4aca9d1a5ec4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108813 Nov 03 01:54:44.428906 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Nov 3 01:54:44 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:54:46.787882 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-305094ad-8daa-42ae-867f-4e98aecbe685 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:46.788894 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-305094ad-8daa-42ae-867f-4e98aecbe685 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 03 01:54:46.789300 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:46.854551 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-375856e5-0537-4591-8a96-1de08322d6e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "disk": 80}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:46.927180 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-375856e5-0537-4591-8a96-1de08322d6e4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.129966 Nov 03 01:54:46.930214 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:46.940783 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-560bcba2-d2bb-458c-adda-730284e2c290 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:47.073972 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-560bcba2-d2bb-458c-adda-730284e2c290 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136678 Nov 03 01:54:47.086238 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Nov 3 01:54:46 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 01:54:49.442902 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-375856e5-0537-4591-8a96-1de08322d6e4 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:54:49.444518 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-375856e5-0537-4591-8a96-1de08322d6e4 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Nov 03 01:54:49.446457 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:54:49 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:54:49.506085 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-5994bd89-7eab-4473-911b-6d9ce4ec2e44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "vcpus": 8}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:49.606582 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-5994bd89-7eab-4473-911b-6d9ce4ec2e44 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.155236 Nov 03 01:54:49.607717 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Nov 3 01:54:49 2021] POST /compute/v2.1/flavors => generated 408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:54:49.620002 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-64b3272e-be8f-4cea-b4df-eaba4bbdcad6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:54:49.706863 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-64b3272e-be8f-4cea-b4df-eaba4bbdcad6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090459 Nov 03 01:54:49.707440 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Nov 3 01:54:49 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:55:30.425085 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-5994bd89-7eab-4473-911b-6d9ce4ec2e44 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:30.426126 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-5994bd89-7eab-4473-911b-6d9ce4ec2e44 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 03 01:55:30.426558 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:55:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:30.483977 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e6a2fe5b-8ddd-4666-adef-f4a9c2daf0c4 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:30.500147 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e6a2fe5b-8ddd-4666-adef-f4a9c2daf0c4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066630 Nov 03 01:55:30.500668 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Nov 3 01:55:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:55:32.008939 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-5994bd89-7eab-4473-911b-6d9ce4ec2e44 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:32.009925 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-5994bd89-7eab-4473-911b-6d9ce4ec2e44 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Nov 03 01:55:32.010346 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:32.199464 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-fe31fbd5-40d0-411f-812a-bbe5f04f36a3 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:32.205110 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.wsgi [None req-fe31fbd5-40d0-411f-812a-bbe5f04f36a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 03 01:55:32.205672 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-fe31fbd5-40d0-411f-812a-bbe5f04f36a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 01:55:32.206490 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-fe31fbd5-40d0-411f-812a-bbe5f04f36a3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059056 Nov 03 01:55:32.206995 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 3 01:55:32 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 01:55:32.217214 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-8d9e4488-f288-412d-acb0-d753e612d600 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:32.237406 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-8d9e4488-f288-412d-acb0-d753e612d600 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023753 Nov 03 01:55:32.237944 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 3 01:55:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:55:32.247734 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-9113aacd-278c-4561-a317-b6430e3a114b admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:32.267848 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-9113aacd-278c-4561-a317-b6430e3a114b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023498 Nov 03 01:55:32.268361 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 3 01:55:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 01:55:32.278393 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-201b110d-4e78-4bb4-acb5-8e480a1bf72e admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:32.283612 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.wsgi [None req-201b110d-4e78-4bb4-acb5-8e480a1bf72e admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 03 01:55:32.284177 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-201b110d-4e78-4bb4-acb5-8e480a1bf72e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 01:55:32.284955 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-201b110d-4e78-4bb4-acb5-8e480a1bf72e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010548 Nov 03 01:55:32.285440 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 3 01:55:32 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 01:55:33.676184 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-9113aacd-278c-4561-a317-b6430e3a114b admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:33.677172 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-9113aacd-278c-4561-a317-b6430e3a114b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Nov 03 01:55:33.677564 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:33.867016 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-1138bea1-f1cc-4065-b871-b1c25ad8c6fc admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:33.872635 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.wsgi [None req-1138bea1-f1cc-4065-b871-b1c25ad8c6fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 03 01:55:33.873188 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-1138bea1-f1cc-4065-b871-b1c25ad8c6fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 01:55:33.873957 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-1138bea1-f1cc-4065-b871-b1c25ad8c6fc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058912 Nov 03 01:55:33.874477 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 3 01:55:33 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 01:55:33.884080 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-3367e1b4-3d3a-4ec8-affd-6eb377e76de9 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:33.897575 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-3367e1b4-3d3a-4ec8-affd-6eb377e76de9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016994 Nov 03 01:55:33.898076 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 3 01:55:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 01:55:33.908123 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-c73b798c-97ae-4ba3-98ef-4bb8d0759954 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:33.921034 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-c73b798c-97ae-4ba3-98ef-4bb8d0759954 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016275 Nov 03 01:55:33.921571 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 3 01:55:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:55:33.930740 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-8fffe3b3-d760-44dd-a07d-c14f25761898 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:33.935816 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.wsgi [None req-8fffe3b3-d760-44dd-a07d-c14f25761898 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 03 01:55:33.936362 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-8fffe3b3-d760-44dd-a07d-c14f25761898 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 01:55:33.937117 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-8fffe3b3-d760-44dd-a07d-c14f25761898 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009708 Nov 03 01:55:33.937585 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 3 01:55:33 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 03 01:55:35.331283 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-c73b798c-97ae-4ba3-98ef-4bb8d0759954 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:35.332308 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-c73b798c-97ae-4ba3-98ef-4bb8d0759954 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 03 01:55:35.332709 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:35.518794 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a547ebc3-2bfc-43c1-b60e-22e75911fb2c admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:35.524307 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.wsgi [None req-a547ebc3-2bfc-43c1-b60e-22e75911fb2c admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 03 01:55:35.524880 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a547ebc3-2bfc-43c1-b60e-22e75911fb2c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 01:55:35.526202 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-a547ebc3-2bfc-43c1-b60e-22e75911fb2c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057361 Nov 03 01:55:35.526687 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 3 01:55:35 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 01:55:35.536361 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-4b241138-fca9-488a-9687-d5061dee36ee admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:35.549653 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-4b241138-fca9-488a-9687-d5061dee36ee admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016689 Nov 03 01:55:35.550110 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 3 01:55:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:55:35.560169 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:35.574277 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017539 Nov 03 01:55:35.574801 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 3 01:55:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:55:35.584831 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-f3c40e53-0190-43cc-85af-83929884635e admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:35.590447 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.wsgi [None req-f3c40e53-0190-43cc-85af-83929884635e admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 03 01:55:35.590997 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-f3c40e53-0190-43cc-85af-83929884635e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 01:55:35.591756 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-f3c40e53-0190-43cc-85af-83929884635e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010401 Nov 03 01:55:35.592230 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 3 01:55:35 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 01:55:36.988092 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:36.989091 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 03 01:55:36.989485 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:37.176455 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-80dcf12b-b453-4cb0-88ca-643cc7bda434 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:55:37.258644 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-80dcf12b-b453-4cb0-88ca-643cc7bda434 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.131837 Nov 03 01:55:37.259103 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 3 01:55:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:55:38.656778 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:38.657768 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Nov 03 01:55:38.658185 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:38.847227 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-e103bf9e-338c-4add-8dc7-ea0ed2b8a8df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:55:38.929774 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-e103bf9e-338c-4add-8dc7-ea0ed2b8a8df admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.132801 Nov 03 01:55:38.930365 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 3 01:55:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 01:55:40.339774 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:40.340778 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Nov 03 01:55:40.341182 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:40.540591 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-5533a748-f858-4640-b8e7-2dd635a52886 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:55:40.636278 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-5533a748-f858-4640-b8e7-2dd635a52886 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.154561 Nov 03 01:55:40.636843 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 3 01:55:40 2021] POST /compute/v2.1/flavors => generated 407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:55:42.080212 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:42.081213 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Nov 03 01:55:42.081609 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:42.271872 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-9ca2488d-da0c-4a7b-926d-3dcb344d3913 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 01:55:42.389873 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-9ca2488d-da0c-4a7b-926d-3dcb344d3913 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.169745 Nov 03 01:55:42.390436 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 3 01:55:42 2021] POST /compute/v2.1/flavors => generated 409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:55:43.789362 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:43.790373 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Nov 03 01:55:43.790771 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:55:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:55:43.977369 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-99dcc8e2-7b45-48ee-9194-de0af7aa6546 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:55:43.996487 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-99dcc8e2-7b45-48ee-9194-de0af7aa6546 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069814 Nov 03 01:55:43.997008 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Wed Nov 3 01:55:43 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:56:30.728422 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:56:30.729430 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-e3103876-2736-4273-a5e8-3f2571ad9604 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 03 01:56:30.729857 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Wed Nov 3 01:56:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:56:30.788162 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-76cb2042-c8fe-4212-b09e-62ea92659350 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:56:30.805574 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-76cb2042-c8fe-4212-b09e-62ea92659350 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069393 Nov 03 01:56:30.806108 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Nov 3 01:56:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 01:56:30.829196 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-a32a58a4-318c-4550-ae38-2b42e47483ec admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:56:30.837386 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-a32a58a4-318c-4550-ae38-2b42e47483ec admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012159 Nov 03 01:56:30.839633 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Wed Nov 3 01:56:30 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:56:30.850084 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-b6398bcf-752f-46ee-abac-4c88583ee731 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:56:30.857549 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-b6398bcf-752f-46ee-abac-4c88583ee731 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011039 Nov 03 01:56:30.858055 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Wed Nov 3 01:56:30 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 01:56:30.869651 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-f2df610a-6cc0-40e5-8530-50676960c184 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:56:30.877009 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-f2df610a-6cc0-40e5-8530-50676960c184 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010786 Nov 03 01:56:30.877514 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Wed Nov 3 01:56:30 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 01:56:30.889143 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:56:30.896390 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010580 Nov 03 01:56:30.896895 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Wed Nov 3 01:56:30 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 01:58:29.296855 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-898362dd-3d9c-4f4a-b95b-e016a54a88e3 tempest-verify_tempest_config-300617033 tempest-verify_tempest_config-300617033-project] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:58:29.298853 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-898362dd-3d9c-4f4a-b95b-e016a54a88e3 tempest-verify_tempest_config-300617033 tempest-verify_tempest_config-300617033-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104660 Nov 03 01:58:29.299419 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Nov 3 01:58:29 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:59:54.359694 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:59:54.360719 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 03 01:59:54.361110 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:59:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:59:54.609969 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-59b76ed4-10f7-4e2e-abaa-247c5c1a42f1 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:59:54.611143 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 01:59:54.611143 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: warnings.warn(msg) Nov 03 01:59:54.612691 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-59b76ed4-10f7-4e2e-abaa-247c5c1a42f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:59:54.613127 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-59b76ed4-10f7-4e2e-abaa-247c5c1a42f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:59:54.613911 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-59b76ed4-10f7-4e2e-abaa-247c5c1a42f1 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:59:54.615001 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-59b76ed4-10f7-4e2e-abaa-247c5c1a42f1 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:59:54.648136 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-59b76ed4-10f7-4e2e-abaa-247c5c1a42f1 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148945 Nov 03 01:59:54.648679 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 3 01:59:54 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 01:59:56.078915 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:59:56.079915 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 03 01:59:56.080308 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 01:59:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 01:59:56.274548 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-3c5d9701-9cc5-4675-9e55-c863c3e3a048 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 01:59:56.275687 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 01:59:56.275687 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: warnings.warn(msg) Nov 03 01:59:56.277186 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-3c5d9701-9cc5-4675-9e55-c863c3e3a048 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:59:56.277623 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-3c5d9701-9cc5-4675-9e55-c863c3e3a048 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:59:56.278447 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-3c5d9701-9cc5-4675-9e55-c863c3e3a048 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 01:59:56.278863 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-3c5d9701-9cc5-4675-9e55-c863c3e3a048 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 01:59:56.297214 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-3c5d9701-9cc5-4675-9e55-c863c3e3a048 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074082 Nov 03 01:59:56.297666 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 3 01:59:56 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:00:08.156458 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:00:08.157479 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 03 02:00:08.157876 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 02:00:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:00:08.348472 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-c7607d7a-b7bc-4287-a938-186e9961d8b6 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:00:08.349649 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:00:08.349649 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: warnings.warn(msg) Nov 03 02:00:08.351224 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-c7607d7a-b7bc-4287-a938-186e9961d8b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:00:08.351666 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-c7607d7a-b7bc-4287-a938-186e9961d8b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:00:08.352452 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-c7607d7a-b7bc-4287-a938-186e9961d8b6 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:00:08.352877 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-c7607d7a-b7bc-4287-a938-186e9961d8b6 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:00:08.377062 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-c7607d7a-b7bc-4287-a938-186e9961d8b6 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079428 Nov 03 02:00:08.377548 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 3 02:00:08 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:00:09.810306 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: DEBUG nova.api.openstack.wsgi [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] Calling method '>' {{(pid=107622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:00:09.811320 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: INFO nova.api.openstack.requestlog [None req-a943f913-a777-497a-866a-f342f931d1b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 03 02:00:09.811724 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: [pid: 107622|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 3 02:00:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:00:10.005278 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG nova.api.openstack.wsgi [None req-571037f0-6fdd-4c60-ad93-947ffd7ee550 admin admin] Calling method '>' {{(pid=107621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:00:10.006442 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:00:10.006442 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: warnings.warn(msg) Nov 03 02:00:10.007964 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-571037f0-6fdd-4c60-ad93-947ffd7ee550 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:00:10.008407 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-571037f0-6fdd-4c60-ad93-947ffd7ee550 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:00:10.009194 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-571037f0-6fdd-4c60-ad93-947ffd7ee550 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:00:10.009614 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: DEBUG oslo_concurrency.lockutils [None req-571037f0-6fdd-4c60-ad93-947ffd7ee550 admin admin] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:00:10.030292 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: INFO nova.api.openstack.requestlog [None req-571037f0-6fdd-4c60-ad93-947ffd7ee550 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075600 Nov 03 02:00:10.030830 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: [pid: 107621|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 3 02:00:09 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:01:06.320520 dv-cinder-815614-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 03 02:01:06.321066 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: Wed Nov 3 02:01:06 2021 - graceful shutdown triggered... Nov 03 02:01:06.321542 dv-cinder-815614-3-iscsi devstack@n-api.service[107622]: Gracefully killing worker 2 (pid: 107622)... Nov 03 02:01:06.321947 dv-cinder-815614-3-iscsi devstack@n-api.service[107621]: Gracefully killing worker 1 (pid: 107621)... Nov 03 02:01:07.322074 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: worker 1 buried after 1 seconds Nov 03 02:01:07.322074 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: worker 2 buried after 1 seconds Nov 03 02:01:07.322752 dv-cinder-815614-3-iscsi devstack@n-api.service[107620]: goodbye to uWSGI. Nov 03 02:01:07.323685 dv-cinder-815614-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 03 02:01:07.324252 dv-cinder-815614-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 03 02:01:07.327062 dv-cinder-815614-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 03 02:01:07.338274 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 3 02:01:07 2021] *** Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: nodename: dv-cinder-815614-3-iscsi Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: machine: x86_64 Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: clock source: unix Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: pcre jit disabled Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: detected number of CPU cores: 4 Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: current working directory: / Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: detected binary path: /usr/bin/uwsgi-core Nov 03 02:01:07.340850 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: your processes number limit is 47680 Nov 03 02:01:07.341685 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: your memory page size is 4096 bytes Nov 03 02:01:07.341685 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: detected max file descriptor number: 2048 Nov 03 02:01:07.341685 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: lock engine: pthread robust mutexes Nov 03 02:01:07.341685 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: thunder lock: enabled Nov 03 02:01:07.341685 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 03 02:01:07.341685 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 03 02:01:07.388534 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: Python main interpreter initialized at 0x555e8567b9c0 Nov 03 02:01:07.388534 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: python threads support enabled Nov 03 02:01:07.388534 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: your server socket listen backlog is limited to 100 connections Nov 03 02:01:07.388534 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: your mercy for graceful operations on workers is 90 seconds Nov 03 02:01:07.388972 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: mapped 403077 bytes (393 KB) for 2 cores Nov 03 02:01:07.388972 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: *** Operational MODE: preforking *** Nov 03 02:01:07.389268 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: *** uWSGI is running in multiple interpreter mode *** Nov 03 02:01:07.389268 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: spawned uWSGI master process (pid: 122994) Nov 03 02:01:07.389471 dv-cinder-815614-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 03 02:01:07.390051 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: spawned uWSGI worker 1 (pid: 123011, cores: 1) Nov 03 02:01:07.390430 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: spawned uWSGI worker 2 (pid: 123012, cores: 1) Nov 03 02:01:07.390594 dv-cinder-815614-3-iscsi devstack@n-api.service[122994]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 03 02:01:09.189989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 02:01:09.189989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: from cryptography.utils import int_from_bytes Nov 03 02:01:09.190689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 02:01:09.190689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: from cryptography.utils import int_from_bytes Nov 03 02:01:09.190689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 02:01:09.190689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: from cryptography.utils import int_from_bytes Nov 03 02:01:09.191299 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 02:01:09.191299 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: from cryptography.utils import int_from_bytes Nov 03 02:01:11.763494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 02:01:11.764177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 02:01:11.764535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 02:01:11.764652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 02:01:11.764758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 02:01:11.764843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 02:01:11.764917 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 02:01:11.765001 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 02:01:11.765076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 02:01:11.765176 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 02:01:11.765263 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.765364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.765451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.765879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.765989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766696 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766878 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.766980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.767179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.767291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.767500 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.767603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.767789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.767889 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.768067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.768242 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.768389 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.768541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-3-iscsi {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.768694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-3-iscsi {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.768866 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.769059 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.769209 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.769365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.769520 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.769664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.769815 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.770502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.770680 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.770826 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.770970 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.771119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.771284 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.771449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.771614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773443 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773562 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773654 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.773974 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774044 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774266 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774422 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774888 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.774966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775125 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775205 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-3-iscsi {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775278 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-3-iscsi {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.775723 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.776035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.776296 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.776441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.776870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777522 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777630 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.777955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.778144 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.778245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.778453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.778576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.778767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.778914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.779150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.779388 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.779514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.779719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.779855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.780032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.780137 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.780331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.780551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.780790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.781006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.781250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.781456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.781685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.781895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.782101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.782373 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.782593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.782819 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783443 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783593 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.783922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.784241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.784241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.784560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.784708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.784897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.784897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.785183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.785335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.785480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.785683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.786400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.786581 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.787219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.787387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.787546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.787699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.787844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.788017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.788721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.788886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.789112 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.789273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.789429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.789595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.789822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.789980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.790174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.790341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.790494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.790651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.790797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.790948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791093 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791236 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791687 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791687 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.791978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.792128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.792278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.792278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.792568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.792729 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.792876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793247 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793400 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793545 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.793998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.794171 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.794322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.794477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.794622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.794773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.794925 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795380 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.795974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.796264 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.796408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.796552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.796708 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.797434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.797596 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.797751 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.797896 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798039 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798371 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.798967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.799125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.799277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.799428 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.799579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.799734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.799963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.800128 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.800274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.800426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.800639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.800799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.802564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.802746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.802908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.803063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.803226 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.803373 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.803531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.803684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.803870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804427 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.804595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.805677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.805834 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.805988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.806160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.806332 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.806488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.806646 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.806791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.807805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.808773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.808930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.809081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.809226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.809376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.809542 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.809691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.809835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.810069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.810288 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.810436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.810590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.810735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.810879 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811033 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811184 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811632 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.811927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812676 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812829 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.812979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.813133 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.813292 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.813452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.813604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.813755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.813907 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.814062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.814239 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.814396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.814549 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.814700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.814869 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.815015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.815159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.815302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.815453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.815606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.815760 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.815912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.816064 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.816208 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.816358 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.816505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 02:01:11.816721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.816915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.817085 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.818072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.818339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.818499 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.818660 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.818814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.818960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.819112 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.819259 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.819413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.819574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.819742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.819890 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.820050 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.820267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.820431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.820577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.820736 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.820890 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821188 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821493 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.821950 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.822094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.822350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.822528 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.822677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.822822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.822965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.823109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.823260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.823418 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.823569 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.823724 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.823869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.824154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.824321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.824474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.824618 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.824773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.825035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.825194 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.825349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.825496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.826295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.831243 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.831475 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.831639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.831793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.831955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.832121 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.832283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.832963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.833122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.833122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.833416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.833577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.833743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.833897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.834049 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.834049 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.834486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.834486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.834773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.834926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.835070 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.835266 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.835461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.835745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.835913 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836077 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836222 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836681 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.836968 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.837123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.837268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.837422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.837574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.837728 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.837880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838199 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838653 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.838950 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839095 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839392 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839680 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.839993 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.840173 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.840333 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.840485 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.840650 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.841014 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.841541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.841691 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.841836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.841995 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.842855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843034 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843500 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843804 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.843964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.844117 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.844265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.844515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.844674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.844832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.844985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.845141 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.845285 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.845606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.845764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.845911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.846844 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.846943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847134 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847311 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847766 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847859 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.847945 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.848039 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.848183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.848782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.848871 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.848956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849334 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849420 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849711 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849885 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.849969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850348 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850441 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850620 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850713 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.850911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851792 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851792 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.851947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852225 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852492 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852670 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852850 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.852936 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853114 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853404 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853490 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853679 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853861 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.853953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854305 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854410 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.854974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855238 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855510 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855696 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.855982 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856153 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856333 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856418 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.856967 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857065 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857244 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857337 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857624 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857888 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.857980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858466 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858741 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.858919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859275 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859369 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.859919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860003 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860190 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860469 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860650 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.860922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861290 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861588 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.861956 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862473 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.862947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863126 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863217 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863303 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863486 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863571 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863667 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.863981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864165 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864259 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.864946 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865217 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865386 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865469 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865823 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.865915 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866000 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866298 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866642 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866878 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.866999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867188 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867471 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867737 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.867921 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.868970 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869050 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869130 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869465 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.869955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.870082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.870360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.870522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.870684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.870836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.870985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.871287 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.871626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.871943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.872260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.872419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.872749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.872845 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.873074 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.873156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.873395 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.873576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.873730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.873820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.874018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.874113 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.874356 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.874533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.874684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.874852 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.875024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.875158 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.875412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.875541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.875747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.875867 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.876072 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.876193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.876370 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.876482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.876678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.876789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877411 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877712 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.877918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.878034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.878248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.878363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.878597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.878710 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.878910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.879020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.879292 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.879956 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880071 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880755 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.880964 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.881067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.881268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.881386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.881738 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.881851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.881949 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882044 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.882981 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.883122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.883263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.883411 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.883570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.883809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.883963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.884105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.884246 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.884393 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.884568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.884708 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.884941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885237 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.885990 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.886153 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.886307 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.886448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.886589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.886735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.886885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887317 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887463 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887757 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.887904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888197 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888629 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888775 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.888926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889215 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889811 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.889985 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.890252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.890397 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.890541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.890692 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.890835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.891038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.891181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.891328 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.891476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.891639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.891993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.892154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.892305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.892448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.892588 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.892742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.892891 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.893033 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.893174 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.893322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.893476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.893634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.893776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894238 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894389 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894692 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.894994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.895250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.895400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.895610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.895757 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.895914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.896066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.896212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.896363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.896588 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.896734 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.896879 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.897116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.897255 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.897402 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.897554 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.897705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.897855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898637 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.898926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899218 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.899917 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900204 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900352 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900792 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.900933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.901080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.901227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.901367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.901580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.901752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.902172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.902317 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.902457 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.902606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.902751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.902904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.903949 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.904197 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.904339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.904483 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.904632 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.904784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.904930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.905085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.905222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.905461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.905621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.905775 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.905927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.906082 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.906248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.906400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.906556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.906700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.906843 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907056 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907207 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907355 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907505 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907655 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907806 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.907947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908249 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.908981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909584 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.909883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.910258 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.910258 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.910539 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.910539 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.911335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.911495 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.911647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.911799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.911951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.912262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.912408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.912572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.912796 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.912943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.913959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.914111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.914300 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.914447 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.914609 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.914760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.914904 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.915047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.915200 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.915343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.915514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.915754 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.915904 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916056 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916663 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.916967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.917111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.917256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.917405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.917549 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.917699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.917923 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.918076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.918282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.918439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.918584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.918738 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.918738 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919772 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.919916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920523 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920817 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.920968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921112 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921254 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921842 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.921993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.922287 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.922456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.922612 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.922756 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.922899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.923119 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.923272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.923431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.923577 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.923726 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.923871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924168 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924464 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924620 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924770 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.924920 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.925146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.925300 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.925451 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.925637 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.925914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.926063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.926317 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.926984 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.927130 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.927286 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.927429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.927604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.927756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.927899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.928043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.928185 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.928335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.929090 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.929254 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.929408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.929554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.929704 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.929871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930030 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930422 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930530 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930631 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930710 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.930943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931662 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931743 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.931968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932888 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.932962 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933034 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933105 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933271 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933353 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933426 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933497 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.933952 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934309 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934479 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.934956 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.935090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.935228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.935360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.935554 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.935699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.935893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936207 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.936983 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.937159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.937294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.937474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.937608 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.937982 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938329 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938427 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938711 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.938815 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939323 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939424 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.939937 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940366 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940525 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940659 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.940958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.941136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.941270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.941441 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.941581 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.941740 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.941900 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.942124 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.942644 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943737 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.943875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944279 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944407 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.944867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945001 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945215 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.945902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946340 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946609 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.946879 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947008 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947138 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.947989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.948171 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.948306 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.948487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.948631 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.948798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.948939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.949110 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.949251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.949450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.949670 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.949801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.950022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.950212 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.958480 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959071 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959544 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.959969 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960168 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960255 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960347 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.960979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961075 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961075 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961239 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961421 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961660 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961847 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.961847 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.962011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.962011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.962210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.962310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.962470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.962470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963261 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963451 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963670 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.963966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964054 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964140 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964885 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.964972 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965220 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965381 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965540 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965690 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965690 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.965953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966257 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966397 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.966988 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967420 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967509 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967682 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.967978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968065 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968332 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968512 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968600 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968694 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.968865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969403 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.969948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970653 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.970919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971236 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971236 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.971993 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972181 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972275 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972468 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.972929 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.973031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.973641 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.973845 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.973943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974331 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974420 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974515 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.974967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975110 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975225 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975495 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975581 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975771 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975771 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.975927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976301 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976436 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976637 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.976992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977184 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977518 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.977925 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.978122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.978249 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.978450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.978545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.978749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.978870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979070 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979485 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.979973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.980080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.980280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.980378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.980604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.980703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.980912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981016 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981220 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.981930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.982164 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.982410 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.982507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.982773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.982935 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.983144 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.983251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.983377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.983474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.983726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.983889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.984103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.984210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.984332 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.984555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.984667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.984941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985674 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.985960 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.986208 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.986310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.986495 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.986654 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.986800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.986895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.987105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.987208 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.987415 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.987524 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.987717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.987816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.988036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.988143 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.988344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.988471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.988651 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.988793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.989495 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.989602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.989805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.989902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.990114 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.990226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.992873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993447 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.993896 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994303 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994666 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994763 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.994943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995133 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995316 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995698 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.995967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996164 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996351 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.996953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997281 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997783 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997879 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.997975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.998162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.998339 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.998448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.998670 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.998774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.998996 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.999092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.999301 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.999410 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.999604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.999707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:11.999905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000003 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000589 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.000999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.001224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.001329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.001536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.001632 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.001859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.001961 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.002187 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.002290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.002501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.002615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.002809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.002907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.003117 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.003250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.003483 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.003618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.003817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.003951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.004080 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.004195 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.004415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.004537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.004727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.004849 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005465 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005778 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.005973 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.006157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.006334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.006551 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.006723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.006995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.007096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.007331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.007436 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.007646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.007740 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.007959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.008998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.009212 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.009322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.009564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.009683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.009875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.009979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.010206 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.010319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.010525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.010632 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.010797 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 02:01:12.010900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.011145 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.011470 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.011797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.012158 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.012507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.012819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.013162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.013491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 02:01:12.013780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 02:01:12.033602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_db.sqlalchemy.engines [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.036602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_db.sqlalchemy.engines [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.112709 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.context [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8df2cde-dfb3-4296-bec6-9291d21b17e1(cell1) {{(pid=123012) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 02:01:12.115034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.context [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8df2cde-dfb3-4296-bec6-9291d21b17e1(cell1) {{(pid=123011) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 02:01:12.117823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:12.119444 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:12.119565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:12.120262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:12.121042 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:12.121855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:12.122285 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:12.123853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:12.132923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_db.sqlalchemy.engines [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.135514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_db.sqlalchemy.engines [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.136840 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_db.sqlalchemy.engines [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.137677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_db.sqlalchemy.engines [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.395578 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_db.sqlalchemy.engines [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.399401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_db.sqlalchemy.engines [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 03 02:01:12.720174 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: WARNING keystonemiddleware.auth_token [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 02:01:12.726967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: WARNING keystonemiddleware.auth_token [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 02:01:12.727282 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: WARNING keystonemiddleware.auth_token [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 02:01:12.733697 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: WARNING keystonemiddleware.auth_token [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 02:01:13.075025 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: WARNING keystonemiddleware.auth_token [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 02:01:13.080281 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: WARNING keystonemiddleware.auth_token [None req-5f61b858-e32b-40ad-bdc6-8ecd5f9197c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 02:01:13.081582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: WARNING keystonemiddleware.auth_token [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 02:01:13.085932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e8567b9c0 pid: 123012 (default app) Nov 03 02:01:13.087473 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: WARNING keystonemiddleware.auth_token [None req-30a48f40-4c40-4f8c-9bae-6a63493e2406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 02:01:13.092553 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e8567b9c0 pid: 123011 (default app) Nov 03 02:01:48.272893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-214fc636-543c-4ba9-ac85-fc40151cf2cb tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Action: 'create', calling method: .version_select at 0x7f30c5c269d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1419787751", "metadata": {"Type": "work"}}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:48.493614 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4b89adc0-af30-4698-9efe-48dccd1f46a5 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Action: 'create', calling method: .version_select at 0x7f30c5c279d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1973473401"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:50.996499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-214fc636-543c-4ba9-ac85-fc40151cf2cb tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.975716 Nov 03 02:01:51.004487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Nov 3 02:01:47 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3979 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 03 02:01:51.053015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4b89adc0-af30-4698-9efe-48dccd1f46a5 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.775774 Nov 03 02:01:51.053714 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1154 bytes} [Wed Nov 3 02:01:47 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3779 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 03 02:01:51.060220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1fc2f2bb-892e-4c08-9593-de53616a27bf tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Calling method '.version_select at 0x7f30c5af0550>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:51.122474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-528029554", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "bb7c4a3f-87fa-4680-9e11-21b7c738f9bc"}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:51.265501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] validate_networks() for [('bb7c4a3f-87fa-4680-9e11-21b7c738f9bc', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:01:51.333455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1fc2f2bb-892e-4c08-9593-de53616a27bf tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9" status: 200 len: 353 microversion: 2.1 time: 0.278184 Nov 03 02:01:51.334252 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:51 2021] GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 => generated 353 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:51.339240 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-90799b09-74cc-43c1-95ca-acf44bd6b5fe tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c5af0dc0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:52.039266 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-90799b09-74cc-43c1-95ca-acf44bd6b5fe tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 200 len: 345 microversion: 2.1 time: 0.703395 Nov 03 02:01:52.040173 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:51 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 345 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:52.211992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:01:52.213280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:01:52.213931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:01:52.214668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:01:52.215284 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:01:52.232127 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:52.233341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:52.234181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:52.235936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:52.276950 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Getting quotas for project 76031e079d5240599980bd51be51f6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:01:52.284458 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Getting quotas for user f9ea14176dbb45ed9d561cd920cf46e4 and project 76031e079d5240599980bd51be51f6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:01:52.296112 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:01:52.299456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:01:52.352772 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-00648f4f-5c94-4624-bbb8-0b68ecb8f487 tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Calling method '.version_select at 0x7f30c5af0ee0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:52.403528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-00648f4f-5c94-4624-bbb8-0b68ecb8f487 tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9" status: 200 len: 354 microversion: 2.1 time: 0.054516 Nov 03 02:01:52.404103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 4/5] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:52 2021] GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:01:52.417474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a318c931-ef39-409d-ada6-2a8b0a13a591 tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Calling method '.version_select at 0x7f30c5b08820>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:52.468556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a318c931-ef39-409d-ada6-2a8b0a13a591 tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9" status: 200 len: 354 microversion: 2.1 time: 0.056916 Nov 03 02:01:52.469118 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 5/6] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:52 2021] GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:01:52.485445 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f6773974-dc0f-46b7-9a7e-66634acd8c1e tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Calling method '.version_select at 0x7f30c5b08ee0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:52.644088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e180c1d9-8fd8-411b-982a-ba996bde236e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644115 Nov 03 02:01:52.645676 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 2/7] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:01:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:01:52.660317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-52b62f3e-97f4-4e8b-87f4-95a086dc04dc tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:52.661935 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-52b62f3e-97f4-4e8b-87f4-95a086dc04dc tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:52.755711 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f6773974-dc0f-46b7-9a7e-66634acd8c1e tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9" status: 202 len: 0 microversion: 2.1 time: 0.274223 Nov 03 02:01:52.759264 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 6/8] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Nov 3 02:01:52 2021] DELETE /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:01:52.764723 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6b4e0627-3b55-434e-9b5c-02c4f9a162d5 tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Calling method '.version_select at 0x7f30c5b088b0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:52.820941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-52b62f3e-97f4-4e8b-87f4-95a086dc04dc tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:52.835526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-52b62f3e-97f4-4e8b-87f4-95a086dc04dc tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1214 microversion: 2.1 time: 0.183229 Nov 03 02:01:52.852733 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 3/9] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:52 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:01:52.852905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6b4e0627-3b55-434e-9b5c-02c4f9a162d5 tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9" status: 200 len: 353 microversion: 2.1 time: 0.091420 Nov 03 02:01:52.854024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 7/10] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:52 2021] GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:53.063454 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ff962ce3-5c66-4dca-87c5-5d32c9595fc1 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c5a03d30>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:53.121290 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ff962ce3-5c66-4dca-87c5-5d32c9595fc1 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 200 len: 346 microversion: 2.1 time: 0.070385 Nov 03 02:01:53.121821 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 4/11] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:53 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:53.133586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-006ea507-b6dd-46f9-806b-0925614da459 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Action: 'create', calling method: .version_select at 0x7f30c5af0e50>, body: {"snapshot": {"volume_id": "ba95f760-6675-4359-9eb4-e74004fe6dfd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1946941807"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:53.854951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1ae7bc40-068b-4fa6-84b2-3b09057c3052 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:53.856123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1ae7bc40-068b-4fa6-84b2-3b09057c3052 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:53.950920 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1ae7bc40-068b-4fa6-84b2-3b09057c3052 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:53.965447 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1ae7bc40-068b-4fa6-84b2-3b09057c3052 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1214 microversion: 2.1 time: 0.115536 Nov 03 02:01:53.966031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 5/12] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:53 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:01:53.986064 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1dc819ec-2361-4f43-aad2-64a4833a7a6b tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Calling method '.version_select at 0x7f30c49c1f70>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:54.061607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-006ea507-b6dd-46f9-806b-0925614da459 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.932209 Nov 03 02:01:54.065476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 8/13] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Nov 3 02:01:53 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:54.076725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-190ca582-bae4-471d-a065-1cb7ec134497 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c5af0dc0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:54.281774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-1dc819ec-2361-4f43-aad2-64a4833a7a6b tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] HTTP exception thrown: Volume b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 could not be found. Nov 03 02:01:54.282427 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1dc819ec-2361-4f43-aad2-64a4833a7a6b tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] Returning 404 to user: Volume b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:01:54.288037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1dc819ec-2361-4f43-aad2-64a4833a7a6b tempest-VolumesGetTestJSON-409437681 tempest-VolumesGetTestJSON-409437681-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9" status: 404 len: 109 microversion: 2.1 time: 0.310240 Nov 03 02:01:54.288037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 6/14] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:01:53 2021] GET /compute/v2.1/os-volumes/b7859362-d8e2-4f7a-b0b2-b76e2ba5dce9 => generated 109 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:01:54.352113 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-190ca582-bae4-471d-a065-1cb7ec134497 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.280572 Nov 03 02:01:54.356932 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 9/15] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:01:54 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:54.366048 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6112ca22-0fcd-48e8-9fb0-f058f52f93d0 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c64cfdc0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:54.978969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6112ca22-0fcd-48e8-9fb0-f058f52f93d0 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.617460 Nov 03 02:01:54.979968 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 7/16] 10.222.0.30 () {58 vars in 1139 bytes} [Wed Nov 3 02:01:54 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:54.983765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3eb62b18-3f83-436a-ba0a-f6ff240e5a2b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:54.984561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3eb62b18-3f83-436a-ba0a-f6ff240e5a2b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:55.002383 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-abe787a9-0b17-4ff3-9184-62a4a28d57f2 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c5a113a0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:55.172127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3eb62b18-3f83-436a-ba0a-f6ff240e5a2b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:55.196121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-abe787a9-0b17-4ff3-9184-62a4a28d57f2 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.206778 Nov 03 02:01:55.196679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:01:54 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:55.203499 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3eb62b18-3f83-436a-ba0a-f6ff240e5a2b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1214 microversion: 2.1 time: 0.224612 Nov 03 02:01:55.204080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:54 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:01:55.487508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9124d23e-2730-4009-9b28-c793c4db2fbc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'create', calling method: .version_select at 0x7f30c49d0e50>, body: {"keypair": {"name": "tempest-keypair-1359087626"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:55.539945 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-9124d23e-2730-4009-9b28-c793c4db2fbc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:01:55.548736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-9124d23e-2730-4009-9b28-c793c4db2fbc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for user c5de27df6f294e9f9c40f6b14315a228 and project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:01:56.207884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-00272855-f46a-498c-9e85-7ce1893acacd tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c5b56550>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:56.212625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-9124d23e-2730-4009-9b28-c793c4db2fbc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:01:56.222967 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-9124d23e-2730-4009-9b28-c793c4db2fbc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for user c5de27df6f294e9f9c40f6b14315a228 and project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:01:56.245860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9124d23e-2730-4009-9b28-c793c4db2fbc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.948247 Nov 03 02:01:56.247230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 9/19] 10.222.0.30 () {62 vars in 1198 bytes} [Wed Nov 3 02:01:55 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 950 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 03 02:01:56.260319 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-00272855-f46a-498c-9e85-7ce1893acacd tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.056995 Nov 03 02:01:56.261096 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 11/20] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:01:56 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:01:56.263098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:56.264084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:56.279476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:56.280218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:56.281170 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:56.284844 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:56.448004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:56.461222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f8872eb8-3571-4055-bd21-3e5ea0aad4cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1218 microversion: 2.1 time: 0.211518 Nov 03 02:01:56.463873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 10/21] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:56 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:01:56.861931 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1756088951", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "736ee5a9-6b0f-40e2-b2ff-a9aa9510814f"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:57.022108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] validate_networks() for [('736ee5a9-6b0f-40e2-b2ff-a9aa9510814f', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:01:57.272355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1b13a0a5-cde7-47d6-be44-f4272da297c2 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c495adc0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:57.335360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1b13a0a5-cde7-47d6-be44-f4272da297c2 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.063334 Nov 03 02:01:57.338667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:01:57 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:01:57.478570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:57.479652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:57.490335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:57.495481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:57.495481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:57.495481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:57.654744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:57.663193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-47dac889-847c-4b6d-8573-a0e0ef2ab111 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1218 microversion: 2.1 time: 0.188886 Nov 03 02:01:57.674451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:57 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:01:57.985242 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:01:57.986032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:01:57.986409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:01:57.987344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:01:57.987766 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:01:58.012416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:58.012862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:58.013869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:58.014340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:58.063890 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Getting quotas for project dcf02d32d2b4466f90bc61e38f1776a8. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:01:58.074282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Getting quotas for user c7a67d6b33834ba6b498e76c41abed93 and project dcf02d32d2b4466f90bc61e38f1776a8. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:01:58.095590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:01:58.102816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:01:58.352396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-00a1ea98-3fc2-4e7b-b26f-8a39596e35ee tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c495adc0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:58.422830 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b0a1afda-757a-4c4e-a3be-4376e9a9682e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.762824 Nov 03 02:01:58.424269 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 12/24] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:01:56 2021] POST /compute/v2.1/servers => generated 383 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:01:58.435042 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5f2a9576-a96d-481c-a6b4-797ab88e5801 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:58.436080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5f2a9576-a96d-481c-a6b4-797ab88e5801 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:58.584767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5f2a9576-a96d-481c-a6b4-797ab88e5801 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:58.597075 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5f2a9576-a96d-481c-a6b4-797ab88e5801 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1222 microversion: 2.1 time: 0.162737 Nov 03 02:01:58.598660 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:58 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:01:58.685549 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:58.687044 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:01:58.699672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:58.703477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:58.706556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:01:58.707639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:01:58.937740 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:01:58.964271 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-66f05e4d-eed7-4d53-ace6-8a54186a0dca tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1266 microversion: 2.1 time: 0.284782 Nov 03 02:01:58.965449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 14/26] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:01:58 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:01:58.971679 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1942648604", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "736ee5a9-6b0f-40e2-b2ff-a9aa9510814f"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:01:59.042321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] validate_networks() for [('736ee5a9-6b0f-40e2-b2ff-a9aa9510814f', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:01:59.391261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-00a1ea98-3fc2-4e7b-b26f-8a39596e35ee tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 288 microversion: 2.1 time: 0.911953 Nov 03 02:01:59.391261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 13/27] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:01:58 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 288 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:01:59.391261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-46b0a480-d27b-44f8-a97a-d32387dd6f37 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c40c1af0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:01:59.593162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-46b0a480-d27b-44f8-a97a-d32387dd6f37 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 202 len: 0 microversion: 2.1 time: 0.325907 Nov 03 02:01:59.593162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 14/28] 10.222.0.30 () {58 vars in 1253 bytes} [Wed Nov 3 02:01:59 2021] DELETE /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:01:59.603834 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-098a3e3d-9f17-45a2-8e86-3bac23dc3350 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c40c1ee0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:00.029706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:02:00.029706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:02:00.029706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:02:00.029706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:02:00.030013 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:02:00.040365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:00.040825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:00.043106 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:00.043695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:00.066803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Getting quotas for project dcf02d32d2b4466f90bc61e38f1776a8. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:02:00.070710 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-098a3e3d-9f17-45a2-8e86-3bac23dc3350 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.475952 Nov 03 02:02:00.071593 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 15/29] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:01:59 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:00.075941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:00.076714 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:00.085391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:00.085851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:00.103558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Getting quotas for user c7a67d6b33834ba6b498e76c41abed93 and project dcf02d32d2b4466f90bc61e38f1776a8. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:02:00.108382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:00.110052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:00.142309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:02:00.154958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:02:00.308132 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:00.318282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4e4c18ff-a5d1-496d-8387-feebbd0d460e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.350653 Nov 03 02:02:00.326967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 15/30] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:01:58 2021] POST /compute/v2.1/servers => generated 383 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:02:00.329514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-92271a1a-952c-4584-ad04-a49e97227450 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1274 microversion: 2.1 time: 0.254667 Nov 03 02:02:00.332880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 16/31] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:00 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:00.339505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6d18f0ec-d1f6-43ee-b021-2a4bf22cfdf9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:00.342951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d18f0ec-d1f6-43ee-b021-2a4bf22cfdf9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:00.395494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-90619864", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1e77ce4-6f11-46e6-a0fa-324d2dbee8c9"}], "security_groups": [{"name": "tempest-securitygroup--1550423681"}], "key_name": "tempest-keypair-1359087626", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:00.476567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d18f0ec-d1f6-43ee-b021-2a4bf22cfdf9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:00.485955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6d18f0ec-d1f6-43ee-b021-2a4bf22cfdf9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1222 microversion: 2.1 time: 0.156264 Nov 03 02:02:00.488569 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 16/32] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:00 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:00.698072 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] validate_networks() for [('f1e77ce4-6f11-46e6-a0fa-324d2dbee8c9', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:02:01.083075 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1012d81d-1d54-4ad7-8e37-e709d8c33ba5 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c51c6dc0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:01.118746 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1012d81d-1d54-4ad7-8e37-e709d8c33ba5 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.040138 Nov 03 02:02:01.119434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 17/33] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:02:01 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:02:01.138408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:02:01.139088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:02:01.139772 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:02:01.140397 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:02:01.141317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:02:01.150104 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:01.151235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:01.153568 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:01.154242 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:01.174339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:02:01.178583 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for user c5de27df6f294e9f9c40f6b14315a228 and project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:02:01.190416 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:02:01.192969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:02:01.331837 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9711a50c-4cf0-438c-b756-7a664aa6a43c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.941210 Nov 03 02:02:01.334470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 17/34] 10.222.0.30 () {62 vars in 1187 bytes} [Wed Nov 3 02:02:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 03 02:02:01.342496 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ff93fb69-fb83-45d9-8ff1-d108e3a474e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:01.343438 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ff93fb69-fb83-45d9-8ff1-d108e3a474e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:01.349294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:01.350996 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:01.360943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:01.365053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:01.365053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:01.365053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:01.426441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ff93fb69-fb83-45d9-8ff1-d108e3a474e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:01.436355 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ff93fb69-fb83-45d9-8ff1-d108e3a474e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:01.439302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ff93fb69-fb83-45d9-8ff1-d108e3a474e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:01.440674 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ff93fb69-fb83-45d9-8ff1-d108e3a474e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1280 microversion: 2.20 time: 0.101695 Nov 03 02:02:01.452434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 18/35] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:01 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:01.458439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:01.466155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9af3f94e-89b2-454a-a23e-bcd87935f3d8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1274 microversion: 2.1 time: 0.121117 Nov 03 02:02:01.467314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 18/36] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:01 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:01.506399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:01.507135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:01.514690 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:01.515136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:01.515905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:01.516488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:01.585601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:01.593015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7d9027ec-4417-4739-864b-754b2b72dd51 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1226 microversion: 2.1 time: 0.090724 Nov 03 02:02:01.593672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 19/37] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:01 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:02.130739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-97378076-0387-4234-8d40-63dc90636e58 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c4063d30>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:02.165099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-97378076-0387-4234-8d40-63dc90636e58 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 200 len: 287 microversion: 2.1 time: 0.038603 Nov 03 02:02:02.165661 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 19/38] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:02:02 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:02.459463 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:02.461018 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:02.467847 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:02.468596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:02.469891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:02.470562 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:02.484448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:02.484981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:02.491567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:02.492086 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:02.492897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:02.495046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:02.606281 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:02.622363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:02.622458 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:02.622537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:02.622537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f06274ea-7f6c-4f2f-b460-807917cba22a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1284 microversion: 2.20 time: 0.167783 Nov 03 02:02:02.623385 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 20/39] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:02 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:02.627995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:02.628782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:02.630275 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-65a96b45-947a-4f92-beb3-60df14e37980 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1274 microversion: 2.1 time: 0.150234 Nov 03 02:02:02.639744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 20/40] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:02 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:02.649159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:02.649615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:02.650655 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:02.651288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:02.714205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:02.721838 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-99a07d07-1df1-428c-978c-379a587789aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1226 microversion: 2.1 time: 0.097203 Nov 03 02:02:02.723520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 21/41] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:02 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:03.177234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-506b1a87-60c8-47d0-8afc-c8525910974f tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c495ab80>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:03.202248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-506b1a87-60c8-47d0-8afc-c8525910974f tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] HTTP exception thrown: Snapshot 9ec8e166-00d1-446d-b2d1-7a3645b23ed5 could not be found. Nov 03 02:02:03.202843 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-506b1a87-60c8-47d0-8afc-c8525910974f tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Returning 404 to user: Snapshot 9ec8e166-00d1-446d-b2d1-7a3645b23ed5 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:03.203685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-506b1a87-60c8-47d0-8afc-c8525910974f tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5" status: 404 len: 111 microversion: 2.1 time: 0.030762 Nov 03 02:02:03.204219 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 21/42] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Nov 3 02:02:03 2021] GET /compute/v2.1/os-snapshots/9ec8e166-00d1-446d-b2d1-7a3645b23ed5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:02:03.212221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9eab10f0-ff15-4ac7-a46d-2d1819d8aeb3 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c48d9820>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:03.500182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9eab10f0-ff15-4ac7-a46d-2d1819d8aeb3 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 202 len: 0 microversion: 2.1 time: 0.291507 Nov 03 02:02:03.500747 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 22/43] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Nov 3 02:02:03 2021] DELETE /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:02:03.508874 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a781f5b1-c211-4fa0-932f-bfbca7bc3edc tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c408fa60>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:03.643977 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:03.645924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:03.655734 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:03.656431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:03.657624 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:03.659105 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:03.661320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a781f5b1-c211-4fa0-932f-bfbca7bc3edc tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 200 len: 345 microversion: 2.1 time: 0.154987 Nov 03 02:02:03.669244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 22/44] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:02:03 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:03.669679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:03.671196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:03.680133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:03.685897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:03.687192 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:03.687968 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:03.735144 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:03.743703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:03.745223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:03.746356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ba5b1332-9a39-482a-aaff-2b7fd380b614 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1284 microversion: 2.20 time: 0.110076 Nov 03 02:02:03.746913 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:03 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:03.751143 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:03.751751 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:03.757542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:03.757994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:03.758802 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:03.759241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:03.761394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:03.769385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-33853695-1619-4aa5-87d6-85c498631e81 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1272 microversion: 2.1 time: 0.105344 Nov 03 02:02:03.769951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 23/46] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:03 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:03.827223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:03.835101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-07c9b26f-ed5b-4999-b2d2-5ffe9cfcf5b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1218 microversion: 2.1 time: 0.087229 Nov 03 02:02:03.835670 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 24/47] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:03 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:04.678997 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9701bb5c-b00c-43e3-a34a-e46c8bd38dfa tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c495aa60>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:04.744257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9701bb5c-b00c-43e3-a34a-e46c8bd38dfa tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 200 len: 345 microversion: 2.1 time: 0.063463 Nov 03 02:02:04.744257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:02:04 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:04.765103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:04.765705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:04.771586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:04.776152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:04.776152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:04.776152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:04.786537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:04.787153 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:04.792996 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:04.793450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:04.794253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:04.794693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:04.833481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:04.841750 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:04.843360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:04.844576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-275f8b4c-122a-43f7-8330-05f42ff6e2bd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1284 microversion: 2.20 time: 0.083185 Nov 03 02:02:04.845194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 25/49] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:04 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:04.856979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:04.857596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:04.865718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:04.865853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:04.865853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:04.866695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:04.867143 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:04.872362 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e5a1c8d4-4811-413c-b6e8-f98255778416 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1272 microversion: 2.1 time: 0.089287 Nov 03 02:02:04.872788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 25/50] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:04 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:04.938927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:04.947153 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0f932549-dcd2-4af1-866b-24d151f6dd76 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1218 microversion: 2.1 time: 0.094395 Nov 03 02:02:04.947724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 26/51] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:04 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:05.765517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-dc1a2e95-32c0-456b-b63b-e14cad7059fc tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c495adc0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:05.850451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-dc1a2e95-32c0-456b-b63b-e14cad7059fc tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 200 len: 345 microversion: 2.1 time: 0.102471 Nov 03 02:02:05.852171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 26/52] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:02:05 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:05.863931 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:05.864665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:05.872402 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:05.876146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:05.876146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:05.876146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:05.888605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:05.889254 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:05.895218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:05.895654 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:05.896433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:05.896866 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:06.008490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:06.012268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:06.018467 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d99f24b6-aaef-463d-8326-65d612b34b4c tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1272 microversion: 2.1 time: 0.132916 Nov 03 02:02:06.019546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 27/53] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:05 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:06.021841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:06.024568 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:06.025296 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:06.030453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:06.031881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:06.032143 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:06.033045 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:06.034228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:06.035514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-70344e4c-1bec-4ee6-ba20-d741c597bca3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.171779 Nov 03 02:02:06.036155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 27/54] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:05 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:06.106827 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:06.117674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9fab0ea0-a7f8-4147-9390-c1b8c518a92e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1218 microversion: 2.1 time: 0.096706 Nov 03 02:02:06.119037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 28/55] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:06 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:06.864543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-606d2511-16dc-4f3f-876a-9e10a17d6e78 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c48b4430>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:06.982433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-606d2511-16dc-4f3f-876a-9e10a17d6e78 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] HTTP exception thrown: Volume ba95f760-6675-4359-9eb4-e74004fe6dfd could not be found. Nov 03 02:02:06.983512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-606d2511-16dc-4f3f-876a-9e10a17d6e78 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Returning 404 to user: Volume ba95f760-6675-4359-9eb4-e74004fe6dfd could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:06.984989 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-606d2511-16dc-4f3f-876a-9e10a17d6e78 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 404 len: 109 microversion: 2.1 time: 0.124922 Nov 03 02:02:06.986942 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 28/56] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:02:06 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:02:07.001813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4a8f8b7b-bb75-455d-9180-7914b8a42aaa tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c40c8160>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:07.038259 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:07.039037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:07.052348 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:07.052859 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:07.053701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:07.054157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:07.349481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:07.362085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5bf21ef5-ed20-4f76-b299-1bb5db98758e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.327849 Nov 03 02:02:07.363207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 29/57] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:07 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:07.368900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:07.371538 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:07.375723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-4a8f8b7b-bb75-455d-9180-7914b8a42aaa tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] HTTP exception thrown: Volume ba95f760-6675-4359-9eb4-e74004fe6dfd could not be found. Nov 03 02:02:07.376318 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4a8f8b7b-bb75-455d-9180-7914b8a42aaa tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Returning 404 to user: Volume ba95f760-6675-4359-9eb4-e74004fe6dfd could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:07.377673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4a8f8b7b-bb75-455d-9180-7914b8a42aaa tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 404 len: 109 microversion: 2.1 time: 0.382018 Nov 03 02:02:07.378507 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 29/58] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Nov 3 02:02:06 2021] DELETE /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 109 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:02:07.385143 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:07.385851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:07.386470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:07.387238 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:07.387387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:07.387691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:07.396617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:07.397584 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:07.398748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:07.399461 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:07.511640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:07.511761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:07.512522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-62c124b8-09ef-4721-8ae3-9a1250ae3e45 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.132837 Nov 03 02:02:07.513068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:07 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:07.515151 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:07.518415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:07.520541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-524ffd13-0390-4689-9e8b-a62dbe5d88f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.155820 Nov 03 02:02:07.521321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 30/60] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:07 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:07.535110 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-01368593-6480-4595-b0e6-488aec70e973 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Calling method '.version_select at 0x7f30c408fa60>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:08.270607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-01368593-6480-4595-b0e6-488aec70e973 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] HTTP exception thrown: Volume ba95f760-6675-4359-9eb4-e74004fe6dfd could not be found. Nov 03 02:02:08.271392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-01368593-6480-4595-b0e6-488aec70e973 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] Returning 404 to user: Volume ba95f760-6675-4359-9eb4-e74004fe6dfd could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:08.272254 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-01368593-6480-4595-b0e6-488aec70e973 tempest-VolumesSnapshotsTestJSON-846287355 tempest-VolumesSnapshotsTestJSON-846287355-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd" status: 404 len: 109 microversion: 2.1 time: 0.758161 Nov 03 02:02:08.274163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 31/61] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:02:07 2021] GET /compute/v2.1/os-volumes/ba95f760-6675-4359-9eb4-e74004fe6dfd => generated 109 bytes in 759 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:02:08.380686 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:08.381183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:08.387893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:08.388503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:08.389415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:08.389865 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:08.537357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:08.538285 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:08.555093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:08.555786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:08.556785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:08.557695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:08.675806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:08.683661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-15ce63f7-9aa9-408a-8902-5e6194f4b2c5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.307643 Nov 03 02:02:08.695047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 31/62] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:08 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:08.699967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:08.700965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:08.707625 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:08.708335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:08.709272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:08.709844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:08.738749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:08.747787 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-831692d8-87ad-47c1-a138-9aac4413b9e6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.217493 Nov 03 02:02:08.748526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 32/63] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:08 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:08.782180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:08.792787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:08.794611 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:08.795790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e830523c-7214-4211-ba60-f0743dcc604f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.099703 Nov 03 02:02:08.796433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 32/64] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:08 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:09.701455 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:09.702151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:09.709013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:09.709714 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:09.710547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:09.710984 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:09.768945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:09.768945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:09.773350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:09.773801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:09.774615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:09.775049 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:09.874342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:09.883520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f3d182b0-ebe9-464a-9684-33b861f9ef82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.121787 Nov 03 02:02:09.884645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 33/65] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:09 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:09.889475 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:09.890079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:09.898587 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:09.899391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:09.900372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:09.900980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:09.910270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:09.917224 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e1907c4b-0327-43c9-9fa8-fa46c6350004 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.219615 Nov 03 02:02:09.927088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 33/66] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:09 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:09.987280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:10.000136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:10.001647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:10.002865 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4a926257-b346-4cbd-aa10-6f7c866f5335 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.117150 Nov 03 02:02:10.003415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 34/67] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:09 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:10.900450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:10.901127 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:10.907865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:10.908411 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:10.911860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:10.911860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:10.936604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:10.936604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:10.944996 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:10.945739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:10.946635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:10.947155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:10.991142 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:11.001647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-028c875f-e6cf-4b1d-a3f9-575ffeff3443 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.104134 Nov 03 02:02:11.001647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 34/68] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:10 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:11.026231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:11.027000 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:11.033947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:11.035789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:11.035789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:11.035789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:11.125734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:11.138661 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:11.140324 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:11.141635 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9cd6d728-3688-4cf3-851d-93efe91dd8aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.124860 Nov 03 02:02:11.142442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 35/69] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:11 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:11.156545 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:11.162823 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4c40fa1a-592f-4d59-8463-7d8a35e847dd tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.232374 Nov 03 02:02:11.163387 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 35/70] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:10 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:11.768803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-11b0737e-d001-479f-842b-41b929bfc83f tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Action: 'create', calling method: .version_select at 0x7f30c4015670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1751596202", "metadata": {"Type": "work"}}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:11.770527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-11b0737e-d001-479f-842b-41b929bfc83f tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:11.771746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-11b0737e-d001-479f-842b-41b929bfc83f tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137460 Nov 03 02:02:11.776962 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 36/71] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Nov 3 02:02:11 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:02:11.781821 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c16a503e-dd78-499b-b3c0-508374fdbbda tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Action: 'create', calling method: .version_select at 0x7f30c4901430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-44034367", "metadata": {"Type": "work"}}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:11.783861 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c16a503e-dd78-499b-b3c0-508374fdbbda tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:11.784643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c16a503e-dd78-499b-b3c0-508374fdbbda tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006691 Nov 03 02:02:11.785484 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 36/72] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Nov 3 02:02:11 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:02:11.794044 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-54228f4a-9de0-4c43-b754-1b5c2651f621 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Action: 'create', calling method: .version_select at 0x7f30c40c1ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-608475600", "metadata": {"Type": "work"}}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:11.795242 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-54228f4a-9de0-4c43-b754-1b5c2651f621 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:11.796035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-54228f4a-9de0-4c43-b754-1b5c2651f621 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005636 Nov 03 02:02:11.801340 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 37/73] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Nov 3 02:02:11 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:02:11.806026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-58483827-3013-4fa0-ab04-f41469f3a54a tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Calling method '.version_select at 0x7f30c48a1820>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:11.833631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-58483827-3013-4fa0-ab04-f41469f3a54a tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] HTTP exception thrown: Volume tempest-invalid-493629087 could not be found. Nov 03 02:02:11.834438 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-58483827-3013-4fa0-ab04-f41469f3a54a tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Returning 404 to user: Volume tempest-invalid-493629087 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:11.836281 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-58483827-3013-4fa0-ab04-f41469f3a54a tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-493629087" status: 404 len: 98 microversion: 2.1 time: 0.033186 Nov 03 02:02:11.837235 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 37/74] 10.222.0.30 () {58 vars in 1214 bytes} [Wed Nov 3 02:02:11 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-493629087 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 03 02:02:11.849918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-acd5e1e1-5109-45eb-a440-b95a1094f46c tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005512 Nov 03 02:02:11.850650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 38/75] 10.222.0.30 () {58 vars in 1139 bytes} [Wed Nov 3 02:02:11 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 03 02:02:11.864565 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d7cea71b-7526-4958-851e-8ef0e6a00f3b tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008532 Nov 03 02:02:11.865084 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 38/76] 10.222.0.30 () {58 vars in 1136 bytes} [Wed Nov 3 02:02:11 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 03 02:02:11.876455 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8ba984a5-7ba9-46b0-af69-960444f22726 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Calling method '.version_select at 0x7f30c4015f70>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:11.902518 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-8ba984a5-7ba9-46b0-af69-960444f22726 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] HTTP exception thrown: Volume 00c9bdfe-a744-498a-801e-ea57b25eeb10 could not be found. Nov 03 02:02:11.903113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8ba984a5-7ba9-46b0-af69-960444f22726 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Returning 404 to user: Volume 00c9bdfe-a744-498a-801e-ea57b25eeb10 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:11.903910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8ba984a5-7ba9-46b0-af69-960444f22726 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/00c9bdfe-a744-498a-801e-ea57b25eeb10" status: 404 len: 109 microversion: 2.1 time: 0.031289 Nov 03 02:02:11.904437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 39/77] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Nov 3 02:02:11 2021] DELETE /compute/v2.1/os-volumes/00c9bdfe-a744-498a-801e-ea57b25eeb10 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 02:02:11.916403 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e6cc6f5e-df64-46c3-aefd-d934748c6172 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Calling method '.version_select at 0x7f30c48a19d0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:11.947246 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-e6cc6f5e-df64-46c3-aefd-d934748c6172 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] HTTP exception thrown: Volume 051d2e22-4eb1-40b0-b9d0-b3e51fc2ac6a could not be found. Nov 03 02:02:11.947863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e6cc6f5e-df64-46c3-aefd-d934748c6172 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] Returning 404 to user: Volume 051d2e22-4eb1-40b0-b9d0-b3e51fc2ac6a could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:02:11.948843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e6cc6f5e-df64-46c3-aefd-d934748c6172 tempest-VolumesNegativeTest-954099249 tempest-VolumesNegativeTest-954099249-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/051d2e22-4eb1-40b0-b9d0-b3e51fc2ac6a" status: 404 len: 109 microversion: 2.1 time: 0.036028 Nov 03 02:02:11.949379 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 39/78] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:02:11 2021] GET /compute/v2.1/os-volumes/051d2e22-4eb1-40b0-b9d0-b3e51fc2ac6a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:02:12.021049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:12.021948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:12.034979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:12.035814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:12.036799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:12.037414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:12.130429 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:12.138058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f87f4cbb-8a9f-48c4-8516-646d5a3943a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.122776 Nov 03 02:02:12.148201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 40/79] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:12 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:12.164705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:12.165523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:12.173921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:12.174629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:12.175596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:12.176329 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:12.179242 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:12.179880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:12.185786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:12.186283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:12.187041 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:12.187751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:12.260382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:12.269041 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:12.270711 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:12.271876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f456afb9-5eed-407b-be7c-addfb09afe4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.111264 Nov 03 02:02:12.272373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 40/80] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:12 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:12.335426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:12.344701 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a7972229-8010-4bc2-8160-c695e110c3f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.169073 Nov 03 02:02:12.345296 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 41/81] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:12 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:13.155221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:13.155863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:13.161713 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:13.162179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:13.162954 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:13.163392 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:13.241541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:13.250999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e3bb7a36-3880-4789-98c6-0c543b0636c3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.098783 Nov 03 02:02:13.252374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 41/82] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:13 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:13.290223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:13.290970 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:13.299007 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:13.299466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:13.300345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:13.300731 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:13.362980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:13.363822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:13.364605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:13.375293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:13.375483 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:13.375845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:13.376662 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:13.377508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:13.377760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:13.379267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5f129f19-64b1-4d3a-80cf-56438999e404 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.092785 Nov 03 02:02:13.380006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 42/83] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:13 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:13.682170 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:13.692664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b34c404a-009a-4fe2-a6ea-117789b2671e tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.334373 Nov 03 02:02:13.693535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 42/84] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:13 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:14.269398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:14.270355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:14.276341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:14.276786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:14.278247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:14.278830 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:14.342344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:14.350849 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9724ecc9-208a-45a7-92bf-e694549ec99f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.085771 Nov 03 02:02:14.351751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 43/85] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:14 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:14.399642 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:14.400256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:14.410868 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:14.411216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:14.412047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:14.413388 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:14.511589 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:14.521822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:14.523632 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:14.524927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-12f24a2b-5e29-4bc9-bca6-971f89817e93 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.129224 Nov 03 02:02:14.525636 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 43/86] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:14 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:14.712377 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:14.713223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:14.720312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:14.721565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:14.723093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:14.724385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:14.883326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:14.946376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e98db9bd-8aca-4f30-b559-62a8c020cd59 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.182111 Nov 03 02:02:14.946376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 44/87] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:14 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:15.369957 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:15.370721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:15.377644 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:15.378450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:15.379432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:15.380216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:15.442979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:15.450920 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ac6d3222-1ad6-4aa5-b0e9-4ec0e5b5d8a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.085342 Nov 03 02:02:15.451489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 44/88] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:15 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:15.544538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:15.545097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:15.551044 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:15.561747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:15.561747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:15.561747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:15.641485 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:15.651043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:15.652550 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:15.653655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-76a3fc56-d049-4772-bf7e-784af1b0d6e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.113472 Nov 03 02:02:15.654222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 45/89] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:15 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:15.909616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:15.911260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:15.921405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:15.921849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:15.922649 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:15.924072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:16.167653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:16.176259 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fccd5d2f-b7fa-4c62-bb74-c4c7a8bd275f tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.271671 Nov 03 02:02:16.185800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 45/90] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:15 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:16.467425 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:16.468046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:16.474256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:16.474700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:16.475464 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:16.475905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:16.544471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:16.556986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5afbff98-1808-4cdc-b489-7d1b544eef63 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.093011 Nov 03 02:02:16.567181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 46/91] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:16 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:16.677872 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:16.701129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:16.701129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:16.701129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:16.701129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:16.701478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:16.750962 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:16.760100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:16.761597 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:16.762726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-741dd4a9-5c81-44a5-b2bf-1db382c81b48 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.088548 Nov 03 02:02:16.763281 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 46/92] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:16 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:17.193019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:17.193639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:17.199466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:17.199932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:17.200690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:17.201113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:17.331393 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:17.339898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6136db0b-54f9-4dbe-9a6b-58fee181c657 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.150703 Nov 03 02:02:17.340792 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 47/93] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:17 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:17.584538 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:17.585162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:17.592272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:17.592861 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:17.593943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:17.594571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:17.666405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:17.674386 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8c649f74-76e0-46af-bdfa-99910adfb167 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1274 microversion: 2.1 time: 0.093893 Nov 03 02:02:17.674671 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 47/94] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:17 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:17.779601 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:17.780289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:17.794021 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:17.794765 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:17.797535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:17.797986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:17.874890 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:17.883546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:17.890958 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:17.892674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-749f812f-5e60-4cbb-b652-02f5b5281b01 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1276 microversion: 2.20 time: 0.116516 Nov 03 02:02:17.895675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 48/95] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:17 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:18.357472 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:18.358815 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:18.369385 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:18.372888 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:18.375773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:18.377066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:18.681732 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:18.691723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:18.692639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:18.695364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9b819429-4e4a-4e94-a0f1-f926d11c4d48 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.337620 Nov 03 02:02:18.696178 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 48/96] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:18 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:18.701562 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:18.702422 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:18.703363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:18.703936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:18.794488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:18.813233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-99a28a81-3225-465a-93ec-a9d29417fdae tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1282 microversion: 2.1 time: 0.115741 Nov 03 02:02:18.813233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 49/97] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:18 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:18.915017 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:18.915914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:18.923225 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:18.924528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:18.925628 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:18.927147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:19.143046 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:19.146982 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:19.148464 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:19.149554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-086e0f64-cbf6-4202-99d8-3a7c3536ca77 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1332 microversion: 2.20 time: 0.242700 Nov 03 02:02:19.150177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 49/98] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:18 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1332 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:19.712359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:19.712985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:19.719292 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:19.719743 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:19.721514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:19.721918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:19.820694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:19.822005 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:19.844019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:19.848295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:19.854996 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:19.855981 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:20.072164 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:20.092609 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e49f2f3f-d629-4f02-a995-a83628c44e67 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1280 microversion: 2.1 time: 0.275759 Nov 03 02:02:20.105933 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 50/99] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:19 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:20.176310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:20.183774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:20.202306 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:20.203149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:20.205219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:20.206608 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:20.399156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:20.408557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:20.410348 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:20.411725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4612195f-67ad-447e-a79a-fef59762a251 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1338 microversion: 2.20 time: 0.246912 Nov 03 02:02:20.412882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 51/100] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:20 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1338 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:20.442690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:20.465262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-32197a56-53e3-4777-a405-aea3bf8710f5 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.753086 Nov 03 02:02:20.480358 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 50/101] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:19 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:20.636397 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-d4316d77-14c9-45d1-a7ae-43f8306530a4 req-6182f849-e1eb-4c4e-9f70-6b4005d222a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9213a9f9-14dc-4c34-9539-b7d0802418e0", "tag": "e9c4cc5e-bace-46c6-b5ad-1295223f054e"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:20.641194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:20.641194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:02:20.660988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d4316d77-14c9-45d1-a7ae-43f8306530a4 req-6182f849-e1eb-4c4e-9f70-6b4005d222a9 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:20.660988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d4316d77-14c9-45d1-a7ae-43f8306530a4 req-6182f849-e1eb-4c4e-9f70-6b4005d222a9 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:20.693611 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-d4316d77-14c9-45d1-a7ae-43f8306530a4 req-6182f849-e1eb-4c4e-9f70-6b4005d222a9 service nova] Creating event network-changed:e9c4cc5e-bace-46c6-b5ad-1295223f054e for instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 on hv-cinder-81561 Nov 03 02:02:20.694558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d4316d77-14c9-45d1-a7ae-43f8306530a4 req-6182f849-e1eb-4c4e-9f70-6b4005d222a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 03 02:02:20.696737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-076d4b72-443c-4563-b676-366682a9f409 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:20.697475 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-076d4b72-443c-4563-b676-366682a9f409 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:20.698684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-076d4b72-443c-4563-b676-366682a9f409 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:20.699404 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-076d4b72-443c-4563-b676-366682a9f409 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:20.712769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.compute.rpcapi [None req-076d4b72-443c-4563-b676-366682a9f409 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 03 02:02:20.714540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-076d4b72-443c-4563-b676-366682a9f409 None None] Releasing lock "compute-rpcapi-router" {{(pid=123011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 02:02:20.762356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-076d4b72-443c-4563-b676-366682a9f409 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347955 Nov 03 02:02:20.764598 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 52/102] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:21.111687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:21.112889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:21.140852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:21.140852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:21.140852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:21.140852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:21.434103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:21.435989 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:21.450829 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:21.451695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:21.452721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:21.453380 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:21.504795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:21.520062 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ff5b6699-691f-4dc2-8787-75d49edd809d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.413583 Nov 03 02:02:21.521042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 51/103] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:21 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:21.530199 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:21.535651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:21.571067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:21.576789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:21.582009 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:21.582250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:22.064866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:22.072933 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:22.074450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:22.075596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b48268c9-2724-4fee-b3f8-8d192301fe92 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.646490 Nov 03 02:02:22.092088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 53/104] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:21 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:22.160244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:22.172549 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-365466c2-4b2d-4179-aeaa-e88e43f48057 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.645173 Nov 03 02:02:22.172549 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 52/105] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:21 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:22.536605 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:22.537829 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:22.550506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:22.552952 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:22.553915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:22.554641 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:22.904624 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:22.918602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-520b7118-c603-4a00-a2be-5fa8b6609cb7 req-47f3f752-8dad-4bcc-9177-d845c4a187d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fe0cb-1e19-4f19-84b4-15e0d56010fe", "tag": "c800a63f-5d20-4479-bff0-75fde1f2c55a"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:22.921390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:22.921390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:02:22.924789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ac70db2d-2adf-4df4-8d7b-bbb80e75bf9c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.391757 Nov 03 02:02:22.938526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 54/106] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:22 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:22.944529 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-520b7118-c603-4a00-a2be-5fa8b6609cb7 req-47f3f752-8dad-4bcc-9177-d845c4a187d5 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:22.945019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-520b7118-c603-4a00-a2be-5fa8b6609cb7 req-47f3f752-8dad-4bcc-9177-d845c4a187d5 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:22.966795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-520b7118-c603-4a00-a2be-5fa8b6609cb7 req-47f3f752-8dad-4bcc-9177-d845c4a187d5 service nova] Creating event network-changed:c800a63f-5d20-4479-bff0-75fde1f2c55a for instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe on hv-cinder-81561 Nov 03 02:02:22.974125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-520b7118-c603-4a00-a2be-5fa8b6609cb7 req-47f3f752-8dad-4bcc-9177-d845c4a187d5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123012) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 03 02:02:22.974125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:22.974125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:22.974125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:22.974125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:22.985948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.compute.rpcapi [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 03 02:02:22.986887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] Releasing lock "compute-rpcapi-router" {{(pid=123012) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 02:02:23.025591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-af68db76-b7fc-4fda-9132-d8601ad43845 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110238 Nov 03 02:02:23.025999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 53/107] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:02:23.104282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:23.106245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:23.115478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:23.116039 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:23.116892 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:23.117386 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:23.203505 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:23.204574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:23.214344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:23.215418 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:23.216358 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:23.216993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:23.660310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:23.670585 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:23.672725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:23.674128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2008e129-4067-45a9-80e4-1b12a6897864 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.573531 Nov 03 02:02:23.674934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 55/108] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:23 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:23.870999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:23.884637 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a2d02e99-2a94-463b-8dd2-77acd257c7a8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.698824 Nov 03 02:02:23.886499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 54/109] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:23 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:23.951060 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:23.953903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:23.968744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:23.971196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:23.971598 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:23.972062 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:24.053887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-e2ba93bc-bd54-4a2a-b060-95e80e173f6a req-1c64e51d-bf3a-450f-a317-184a954176d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a688c2f-9028-4f08-8542-7b09dad06fa2", "tag": "1efa8020-26b3-4ca8-a452-4afc4f914e61"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:24.055817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:24.055817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:02:24.063677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-e2ba93bc-bd54-4a2a-b060-95e80e173f6a req-1c64e51d-bf3a-450f-a317-184a954176d3 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:24.064956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-e2ba93bc-bd54-4a2a-b060-95e80e173f6a req-1c64e51d-bf3a-450f-a317-184a954176d3 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:24.080607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-e2ba93bc-bd54-4a2a-b060-95e80e173f6a req-1c64e51d-bf3a-450f-a317-184a954176d3 service nova] Creating event network-changed:1efa8020-26b3-4ca8-a452-4afc4f914e61 for instance 0a688c2f-9028-4f08-8542-7b09dad06fa2 on hv-cinder-81561 Nov 03 02:02:24.087056 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-e2ba93bc-bd54-4a2a-b060-95e80e173f6a req-1c64e51d-bf3a-450f-a317-184a954176d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410318 Nov 03 02:02:24.088229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 56/110] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:24.692935 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:24.693700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:24.702899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:24.703344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:24.715417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:24.715417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:24.715984 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:24.726166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-243bc43e-a565-4f7d-b61e-aa6b34adbb6e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.782253 Nov 03 02:02:24.737682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 55/111] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:23 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:24.903234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:24.903868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:24.924651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:24.924651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:24.924651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:24.924947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:25.478335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:25.494357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:25.494357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:25.494357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4daf9fd9-e520-4de2-8edd-bc53008d83c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.803180 Nov 03 02:02:25.494598 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 57/112] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:24 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:25.584440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:25.593913 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-21adbc3e-da54-4319-89c4-adccdd9cd6a3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.696990 Nov 03 02:02:25.594602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 56/113] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:24 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:25.745399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:25.746054 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:25.757432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:25.771162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:25.772040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:25.772507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:25.992283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:25.999938 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a5bc6919-7525-4cb0-97df-4ac71e8b1668 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.258966 Nov 03 02:02:26.000520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 58/114] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:25 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:26.109054 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-790cc17f-7651-484d-8f30-47e8be378449 req-34760eee-ff24-44de-948a-544b7e34a321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:26.110868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:26.110868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:02:26.118062 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-790cc17f-7651-484d-8f30-47e8be378449 req-34760eee-ff24-44de-948a-544b7e34a321 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:26.118627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-790cc17f-7651-484d-8f30-47e8be378449 req-34760eee-ff24-44de-948a-544b7e34a321 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:26.130565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-790cc17f-7651-484d-8f30-47e8be378449 req-34760eee-ff24-44de-948a-544b7e34a321 service nova] Creating event network-changed:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:02:26.136247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-790cc17f-7651-484d-8f30-47e8be378449 req-34760eee-ff24-44de-948a-544b7e34a321 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031156 Nov 03 02:02:26.137440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 57/115] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:26.511070 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:26.511731 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:26.519948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:26.521774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:26.522924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:26.527723 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:26.617320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:26.620311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:26.635886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:26.637361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:26.639686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:26.642716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:26.868897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:26.889804 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:26.893424 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:26.897099 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a18335a2-3484-4775-bee4-4e86f4bfb534 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.387583 Nov 03 02:02:26.909457 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 59/116] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:26 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:27.019947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:27.020906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:27.028369 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:27.030948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:27.031761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:27.034709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:27.059822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:27.066002 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1306815f-4fb8-4975-bc8a-23f40f3e7882 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.457216 Nov 03 02:02:27.066792 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 58/117] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:26 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:27.191315 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:27.199867 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1add888e-91e8-46ac-95fb-061072b67578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.183512 Nov 03 02:02:27.200257 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 60/118] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:27 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:27.919545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:27.920739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:27.930867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:27.931406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:27.933750 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:27.933750 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:28.084155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:28.084931 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:28.091256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:28.091881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:28.092797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:28.093376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:28.121227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:28.129596 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:28.131143 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:28.132260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6255f101-6913-4f1d-ab94-8694b272b248 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.217512 Nov 03 02:02:28.132847 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 59/119] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:27 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:28.216954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:28.217936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:28.226270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:28.227319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:28.228434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:28.229045 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:28.254801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:28.266634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f1833eae-cbb3-4367-8811-fd9cf2a817a2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.187649 Nov 03 02:02:28.267289 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 61/120] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:28 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:28.401988 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:28.417111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f855e852-1b14-4224-a626-f698e3c4ae9a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.202504 Nov 03 02:02:28.427094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 60/121] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:28 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:29.142563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-a8311fe6-9bdc-4998-9ee9-8305c899a3fd req-5e9ea9c7-3ea7-4c82-9655-45cf031e0298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a688c2f-9028-4f08-8542-7b09dad06fa2", "name": "network-vif-plugged", "status": "completed", "tag": "1efa8020-26b3-4ca8-a452-4afc4f914e61"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:29.144097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:29.144097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:02:29.151490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:29.158846 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:29.159022 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-a8311fe6-9bdc-4998-9ee9-8305c899a3fd req-5e9ea9c7-3ea7-4c82-9655-45cf031e0298 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.159293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-a8311fe6-9bdc-4998-9ee9-8305c899a3fd req-5e9ea9c7-3ea7-4c82-9655-45cf031e0298 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.167735 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.168638 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.169745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.170445 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.178487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-a8311fe6-9bdc-4998-9ee9-8305c899a3fd req-5e9ea9c7-3ea7-4c82-9655-45cf031e0298 service nova] Creating event network-vif-plugged:1efa8020-26b3-4ca8-a452-4afc4f914e61 for instance 0a688c2f-9028-4f08-8542-7b09dad06fa2 on hv-cinder-81561 Nov 03 02:02:29.197468 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-a8311fe6-9bdc-4998-9ee9-8305c899a3fd req-5e9ea9c7-3ea7-4c82-9655-45cf031e0298 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340441 Nov 03 02:02:29.198066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 62/122] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:29.288677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:29.289591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:29.296188 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.296631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.297430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.297924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.341192 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:29.365173 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:29.366989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:29.369784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3c27fe52-5c84-4a7c-923a-ec4f7bba1dab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.221559 Nov 03 02:02:29.369784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 61/123] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:29 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:29.434746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:29.435570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:29.444709 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.445428 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.450109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:29.450895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:29.484526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:29.497330 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0ba8248e-047d-41bd-8a01-cad39ae33956 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.212519 Nov 03 02:02:29.498019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 63/124] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:29 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:29.602623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:29.613982 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-baa39341-9cf6-4555-ac52-547fc3e2d873 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.182718 Nov 03 02:02:29.614573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 62/125] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:29 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:30.387290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:30.387895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:30.394224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:30.394676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:30.395462 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:30.395881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:30.514266 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:30.515562 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:30.522501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:30.523058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:30.523413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:30.524148 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:30.524765 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:30.531272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:30.532826 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:30.533905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1709a184-44b5-48b3-8734-a1289c37dbe7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.150273 Nov 03 02:02:30.544689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 64/126] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:30 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:30.630933 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:30.631534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:30.637660 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:30.638221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:30.639007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:30.639443 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:30.665891 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:30.673199 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bdf37329-a04d-4708-819b-a7a8675fe856 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.162557 Nov 03 02:02:30.682451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 63/127] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:30 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:30.789063 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:30.796933 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f9b0604f-2089-468d-a055-f2a1d32b0d0e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.169515 Nov 03 02:02:30.797738 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 65/128] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:30 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:31.235099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-6121638f-d227-4967-942c-38ef002105ea req-69b893a8-7134-461c-9b2b-01a280aec61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6fe0cb-1e19-4f19-84b4-15e0d56010fe", "name": "network-vif-plugged", "status": "completed", "tag": "c800a63f-5d20-4479-bff0-75fde1f2c55a"}, {"server_uuid": "9213a9f9-14dc-4c34-9539-b7d0802418e0", "name": "network-vif-plugged", "status": "completed", "tag": "e9c4cc5e-bace-46c6-b5ad-1295223f054e"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:31.237154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:31.237154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:02:31.249443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-6121638f-d227-4967-942c-38ef002105ea req-69b893a8-7134-461c-9b2b-01a280aec61d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.250116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-6121638f-d227-4967-942c-38ef002105ea req-69b893a8-7134-461c-9b2b-01a280aec61d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.269586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-6121638f-d227-4967-942c-38ef002105ea req-69b893a8-7134-461c-9b2b-01a280aec61d service nova] Creating event network-vif-plugged:c800a63f-5d20-4479-bff0-75fde1f2c55a for instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe on hv-cinder-81561 Nov 03 02:02:31.270415 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-6121638f-d227-4967-942c-38ef002105ea req-69b893a8-7134-461c-9b2b-01a280aec61d service nova] Creating event network-vif-plugged:e9c4cc5e-bace-46c6-b5ad-1295223f054e for instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 on hv-cinder-81561 Nov 03 02:02:31.278209 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-6121638f-d227-4967-942c-38ef002105ea req-69b893a8-7134-461c-9b2b-01a280aec61d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046192 Nov 03 02:02:31.279325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 64/129] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:31 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:31.550514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:31.551138 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:31.558329 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.558894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.560272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.560782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.692881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:31.693606 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:31.708121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.709145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.709977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.710436 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.714245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:31.725459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:31.729270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:31.731101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-222435ba-da04-4962-9457-f72802810ab9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.184137 Nov 03 02:02:31.732006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 66/130] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:31 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:31.816085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:31.818199 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:31.826200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.827248 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.828313 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:31.830331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:31.950366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:31.960032 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9b709cc1-3a61-443a-871b-46234648a1b2 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.272616 Nov 03 02:02:31.960634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 65/131] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:31 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:32.041730 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:32.049365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7de30d21-9bea-4be6-abad-c7fdc744ee42 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.238017 Nov 03 02:02:32.049854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 67/132] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:31 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:32.749256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:32.749860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:32.755894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:32.756337 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:32.757093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:32.757516 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:32.885957 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:32.892991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:32.894521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:32.895621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f181a56b-8496-4c0b-8e71-711958ac9dc2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.150061 Nov 03 02:02:32.896202 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 66/133] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:32 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:32.977927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:32.978530 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:32.987030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:32.987030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:32.987030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:32.987233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:33.066022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:33.066917 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:33.074031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:33.074537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:33.075380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:33.075820 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:33.172703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:33.182885 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ea510f50-1da0-45d4-8d25-bf22cbd615f3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.209269 Nov 03 02:02:33.183722 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 68/134] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:32 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:33.246301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:33.255977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e6e81062-0384-4a8a-b203-8ac67de8c21a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.193687 Nov 03 02:02:33.256720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 67/135] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:33 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:33.915809 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:33.920742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:33.923870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:33.924326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:33.925095 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:33.925521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:34.063056 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:34.071877 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:34.073446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:34.074754 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ffdeb7cb-9a77-49c3-b096-d90988418735 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.165223 Nov 03 02:02:34.075596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 69/136] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:33 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:34.199623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:34.200223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:34.205919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:34.206394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:34.207211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:34.207637 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:34.272853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:34.273470 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:34.280121 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:34.281007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:34.282171 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:34.283336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:34.370027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:34.377994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-dbfc6d6d-5b7b-46e0-abde-0fb0a9722b0d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.181760 Nov 03 02:02:34.378805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 68/137] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:34 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:34.597656 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:34.605195 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e278614f-fd03-4552-b79d-1ebc8891a24b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.335999 Nov 03 02:02:34.605764 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 70/138] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:34 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:35.095621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:35.097954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:35.107258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:35.107855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:35.109234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:35.109678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:35.312639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:35.321628 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:35.323650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:35.324962 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-272d6f6d-6c0f-4909-a397-6bc30f223283 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.235814 Nov 03 02:02:35.326221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 69/139] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:35 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:35.394739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:35.395463 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:35.401582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:35.402098 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:35.402907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:35.403339 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:35.556624 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:35.565104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5acffcf8-6d79-42f2-b827-8718c1c97199 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.173973 Nov 03 02:02:35.568474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 71/140] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:35 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:35.625912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:35.627245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:35.633625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:35.634072 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:35.634885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:35.635313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:35.784980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:35.792808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-114e478f-dbc7-4a7a-b83c-7f8c09f411b0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.174530 Nov 03 02:02:35.793446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 70/141] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:35 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:36.343115 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:36.343749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:36.349594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:36.350097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:36.350997 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:36.351433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:36.584521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:36.585137 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:36.601600 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:36.602052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:36.606278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:36.606278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:36.611156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:36.622800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:36.635663 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:36.636830 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a7dfeaa9-22b7-4621-9215-dd5c359c6b87 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.297396 Nov 03 02:02:36.637406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 72/142] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:36 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:36.765642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:36.774370 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3a050532-4518-4f59-b2ea-0199791c3e65 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.193349 Nov 03 02:02:36.775073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 71/143] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:36 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:36.816255 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:36.816915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:36.823720 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:36.824166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:36.825124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:36.825716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:37.006120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-2561102a-97f1-46d9-9850-65c2b2ea0c5c req-d89c863d-c3db-48d2-84ee-58e014df5d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "name": "network-vif-plugged", "status": "completed", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:37.008156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:37.008156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:02:37.016600 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-2561102a-97f1-46d9-9850-65c2b2ea0c5c req-d89c863d-c3db-48d2-84ee-58e014df5d7c service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:37.017796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-2561102a-97f1-46d9-9850-65c2b2ea0c5c req-d89c863d-c3db-48d2-84ee-58e014df5d7c service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:37.033412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:37.040069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-2561102a-97f1-46d9-9850-65c2b2ea0c5c req-d89c863d-c3db-48d2-84ee-58e014df5d7c service nova] Creating event network-vif-plugged:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:02:37.043429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-244848bb-cd61-44b2-b1cd-ae9d81818a3e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.231871 Nov 03 02:02:37.044304 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 73/144] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:36 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:37.057258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-2561102a-97f1-46d9-9850-65c2b2ea0c5c req-d89c863d-c3db-48d2-84ee-58e014df5d7c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055916 Nov 03 02:02:37.058366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 72/145] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:02:37.655227 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:37.655980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:37.662639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:37.663081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:37.663894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:37.664319 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:37.800440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:37.801175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:37.819911 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:37.822997 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:37.824056 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:37.825205 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:37.862455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:37.870563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:37.872031 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:37.873119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b6a03672-b76f-4394-ae49-3d611fc2622a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.221745 Nov 03 02:02:37.873837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 74/146] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:37 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:37.984189 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:37.992052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e7b204bb-d1dc-4d4a-b47a-6773a02f8110 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1314 microversion: 2.1 time: 0.203675 Nov 03 02:02:37.992626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 73/147] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:37 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:38.062232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:38.062908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:38.073797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:38.074272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:38.075064 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:38.075495 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:38.226638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:38.233744 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-16c18ea3-4d3a-4904-a2e6-7cc189f14871 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1322 microversion: 2.1 time: 0.175703 Nov 03 02:02:38.234325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 75/148] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:38 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:38.893087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:38.894223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:38.904613 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:38.912643 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:38.913704 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:38.914245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.008773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:39.009452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:39.017035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:39.018264 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.020480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:39.021412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.200738 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:39.214117 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:39.216511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:39.218463 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5f48a830-68af-4e58-93de-c72e263c1f57 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1406 microversion: 2.20 time: 0.330965 Nov 03 02:02:39.219256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 74/149] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:38 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:39.250985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:39.251853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:39.258016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:39.258570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.259340 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:39.259765 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.351572 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:39.361282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-373dfbbd-514f-4d73-a179-f3eba84f86cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1501 microversion: 2.1 time: 0.355790 Nov 03 02:02:39.378557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 76/150] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:39 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:39.461831 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:39.465136 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0386e3eb-31e4-42c8-a53b-08214cfe7bdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1517 microversion: 2.1 time: 0.218025 Nov 03 02:02:39.465711 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 75/151] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:39 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:39.492117 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:39.493412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:39.503934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:39.504383 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.505164 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:39.505593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:39.626890 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lazy-loading 'flavor' on Instance uuid 0a688c2f-9028-4f08-8542-7b09dad06fa2 {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:02:40.144793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7760cc8f-725a-4479-b535-099fafdc022f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2/action" status: 200 len: 32 microversion: 2.1 time: 0.656434 Nov 03 02:02:40.145432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 77/152] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:02:39 2021] POST /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2/action => generated 32 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:02:40.156007 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:40.156622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:40.163547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:40.164070 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:40.164910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:40.165426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:40.241991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:40.241991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:40.263437 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:40.264078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:40.265194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:40.269669 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:40.364120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:40.371972 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0be6d21c-91a0-4549-bdfa-199611241363 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.220097 Nov 03 02:02:40.372912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 76/153] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:40 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:40.517401 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:40.528567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:40.531192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:40.531365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-df711199-465a-449b-a763-0c703557f9ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1599 microversion: 2.20 time: 0.298748 Nov 03 02:02:40.537869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 78/154] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:02:40 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1599 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:40.557378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:40.558460 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:40.569392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:40.569872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:40.572349 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:40.572824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:40.836230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-02551966-efd1-4776-a0a3-f3a17b94ebc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.288170 Nov 03 02:02:40.837884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 77/155] 10.222.0.30 () {60 vars in 1315 bytes} [Wed Nov 3 02:02:40 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-interface => generated 285 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:02:41.389794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:41.391230 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:41.398040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:41.398891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:41.399684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:41.400443 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:41.554427 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b995795a-4073-45a5-8d13-2027d306520e"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:41.556834 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:41.564725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:41.569334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:41.570384 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:41.571113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:41.589983 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:41.598849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6ce04fb9-61d8-4b98-acf0-4a75b72e39bd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.213896 Nov 03 02:02:41.599709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 79/156] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:41 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:42.628174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:42.628174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:42.628174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:42.628174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:42.629478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:42.629478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:42.809382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:42.824703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-71f23914-dbe8-4b3b-8d9c-2f9ae9a38460 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.212329 Nov 03 02:02:42.842863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 80/157] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:42 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:42.842863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:42.842863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:42.847099 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:42.848129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:42.848973 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:42.849623 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:42.887577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3fbb02b8-d35f-47cd-aa59-dfe74f9e5cf3 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "POST /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.342916 Nov 03 02:02:42.893678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 78/158] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:02:41 2021] POST /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0/os-volume_attachments => generated 194 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:42.917712 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-a1061cf5-7553-4c43-9684-2e820bf92645 req-300262ca-7fa1-49d7-a758-ffd41c9c3158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:42.919487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:02:42.919487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:02:42.938166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-a1061cf5-7553-4c43-9684-2e820bf92645 req-300262ca-7fa1-49d7-a758-ffd41c9c3158 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:42.938674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-a1061cf5-7553-4c43-9684-2e820bf92645 req-300262ca-7fa1-49d7-a758-ffd41c9c3158 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:42.944343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-694e0a0d-8488-4311-8a47-20370939aa8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 0.108732 Nov 03 02:02:42.944976 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 81/159] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:42 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:42.950284 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-a1061cf5-7553-4c43-9684-2e820bf92645 req-300262ca-7fa1-49d7-a758-ffd41c9c3158 service nova] Creating event network-changed:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:02:42.957668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-a1061cf5-7553-4c43-9684-2e820bf92645 req-300262ca-7fa1-49d7-a758-ffd41c9c3158 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068042 Nov 03 02:02:42.958336 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 79/160] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:02:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:02:43.856140 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:43.856140 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:43.864735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:43.865373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:43.866837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:43.867430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:43.956445 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:43.957433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:43.963699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:43.964148 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:43.965125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:43.965831 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:44.040767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-545a3b26-7fa3-42b8-a6cd-de31db822cde tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 0.088562 Nov 03 02:02:44.041390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 80/161] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:43 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:44.047003 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:44.060429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a92ad14a-7385-4574-87c3-c71d82822686 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.220629 Nov 03 02:02:44.061102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 82/162] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:43 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:45.052487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:45.053525 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:45.060082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:45.060523 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:45.061297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:45.061728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:45.077677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:45.078374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:45.087411 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:45.087854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:45.088863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:45.089365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:45.135095 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2c6fd7aa-ca99-4eb9-abae-c81a165790ea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 0.086804 Nov 03 02:02:45.135781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 81/163] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:45 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:45.248161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:45.256219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-35e49f3e-d4aa-45cc-96d4-8e530fbd7e74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.182244 Nov 03 02:02:45.256884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 83/164] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:45 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:46.148327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:46.151229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:46.156104 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:46.156615 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:46.157477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:46.157980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:46.225039 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b79b1d51-faa6-4278-9eca-478aaaeac644 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 0.082206 Nov 03 02:02:46.225547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 82/165] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:46 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:46.272990 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:46.273592 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:46.279830 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:46.280273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:46.281035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:46.281460 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:46.570121 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:46.577284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6a77edda-95c7-48b3-b77a-3f1bf9363bb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.307845 Nov 03 02:02:46.577871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 84/166] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:46 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:47.235053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:47.236571 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:47.243243 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:47.243686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:47.244452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:47.244884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:47.593830 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:47.594476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:47.601288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:47.601725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:47.602515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:47.602942 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:47.807811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:47.807811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1927e81a-7a81-465b-84f6-4947048cba74 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.167250 Nov 03 02:02:47.807811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 85/167] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:47 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:48.824487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:48.825125 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:48.831937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:48.832372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:48.833144 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:48.833623 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:48.972595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:48.979836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-230c4b01-e757-4686-8d83-04b77ea56d8e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.159111 Nov 03 02:02:48.980425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 86/168] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:48 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:49.996543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:49.997305 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:50.003717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:50.004159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:50.004950 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:50.005377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:50.132508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:50.145626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f32a30f8-8378-4274-b994-707543856d82 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.152990 Nov 03 02:02:50.146210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 87/169] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:49 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:50.181930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4f32d88f-60a6-41b7-a04e-ef56da5703aa tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 2.950718 Nov 03 02:02:50.182592 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 83/170] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:47 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:51.165383 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:51.166196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:51.174430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:51.174874 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:51.175645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:51.176094 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:51.193602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:51.194726 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:51.201986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:51.202477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:51.203273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:51.203765 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:51.338119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:51.344890 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b07e3fae-2a94-425b-b7ec-5f7420d11fe8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.185514 Nov 03 02:02:51.349992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 88/171] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:51 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:52.364295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:52.365560 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:52.371707 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:52.372154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:52.372911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:52.373499 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:52.503099 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:52.510336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8358aca0-a2e0-4d8c-80e9-d3f907148379 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.149569 Nov 03 02:02:52.510895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 89/172] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:52 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:53.526356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:53.526966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:53.533107 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:53.533547 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:53.534336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:53.534768 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:53.671006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:53.678958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-018d14bd-d7b8-4df7-b13c-cccea57f5223 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.156163 Nov 03 02:02:53.679539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 90/173] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:53 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:53.810980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a1e217ab-174b-48bd-ae05-d199c3dd63da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 2.621927 Nov 03 02:02:53.811809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 84/174] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:51 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:54.695415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:54.696081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:54.703447 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:54.703969 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:54.705318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:54.705765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:54.821638 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:54.822774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:54.834218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:54.834864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:54.835768 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:54.836253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:54.843374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:54.851401 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3e7b7ed2-eeda-4afe-9f15-4c48edd0f938 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.159858 Nov 03 02:02:54.851958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 91/175] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:54 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:54.913732 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-209656c6-f3c7-4e42-8075-f53dd2e2a7ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 14 microversion: 2.20 time: 0.095999 Nov 03 02:02:54.914900 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 85/176] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:54 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:55.883905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:55.885209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:55.907538 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:55.908214 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:55.909393 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:55.910532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:55.926161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:55.927172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:55.936335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:55.937002 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:55.937787 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:55.946102 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:56.043018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a814bf6a-e2b9-4a5b-9117-2a29c1dfc938 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 1407 microversion: 2.20 time: 0.121734 Nov 03 02:02:56.043673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 86/177] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:55 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 1407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:02:56.080465 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:56.087694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f34b84c9-e316-4710-bc30-ff692f78c65e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.220636 Nov 03 02:02:56.088292 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 92/178] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:55 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:56.276564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:56.281373 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:56.293793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:56.294266 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:56.298908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:56.300502 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:56.388799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Going to try to terminate instance {{(pid=123012) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:02:56.818802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-647971fa-23bf-4251-b21e-abf6def845cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 204 len: 0 microversion: 2.1 time: 0.552562 Nov 03 02:02:56.819347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 87/179] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:02:56 2021] DELETE /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:02:56.827708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:56.828340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:56.837149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:56.837680 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:56.838742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:56.839392 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:56.994737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:57.002714 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6e1a978f-d81c-4b90-93b5-8e3e51c0a5cb tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1553 microversion: 2.1 time: 0.178632 Nov 03 02:02:57.003290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 93/180] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:56 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:57.054348 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:57.055330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:57.061329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:57.061770 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:57.062572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:57.063002 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:57.103251 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:57.103855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:57.109542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:57.110014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:57.110816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:57.111244 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:57.165654 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f7ae0599-3d79-4bda-8e46-347e65f0c929 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 8637 microversion: 2.20 time: 0.115246 Nov 03 02:02:57.166316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 88/181] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:57 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 8637 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:02:57.240946 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:57.248216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fd4b3a97-848b-4bbd-9752-2655cdaeba35 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.148546 Nov 03 02:02:57.248783 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 94/182] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:57 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:58.021564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:58.022573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:58.029860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:58.030386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:58.031315 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:58.032298 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:58.172479 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:58.180728 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:58.183141 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:58.183254 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f6a7896a-ab15-47e6-9c39-0c06449c8712 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1553 microversion: 2.1 time: 0.166258 Nov 03 02:02:58.192705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:58.192705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:58.192705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:58.192705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:58.193646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 89/183] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:58 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:58.264767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:58.269230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:58.271725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:58.272178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:58.275571 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:58.275571 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:58.296042 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4618d6a0-21f1-4888-b6ab-cb47c2537999 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 12613 microversion: 2.20 time: 0.123036 Nov 03 02:02:58.297285 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 95/184] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:58 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 12613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:02:58.429887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:58.438696 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-efe06089-1e01-449f-bfd5-758b97ca97ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.177450 Nov 03 02:02:58.439280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 90/185] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:58 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:02:59.200302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:59.201007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:59.207731 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:59.208183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:59.208953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:59.209384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:59.309846 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:02:59.313381 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:59.322612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:59.323466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:59.324450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:59.325057 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:59.446923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-496228f9-00cb-441d-88ee-f9f9ac6fa78c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 15801 microversion: 2.20 time: 0.139599 Nov 03 02:02:59.446923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 91/186] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:02:59 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 15801 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:02:59.457356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:59.462414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:02:59.464518 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:02:59.472794 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:59.473429 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:59.474555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:02:59.475167 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:02:59.475628 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e2214e6f-1656-4df9-846e-f6dce6efca18 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1553 microversion: 2.1 time: 0.279113 Nov 03 02:02:59.482362 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 96/187] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:59 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:02:59.818471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:02:59.825773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-49841e27-b053-49b3-a347-0a0a28bb6ac6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.367253 Nov 03 02:02:59.826369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 92/188] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:02:59 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:00.335805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-7adf21d0-a267-4c28-a92c-08a4205f9502 req-8497f599-9db1-44f3-8d8d-498198e52040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9213a9f9-14dc-4c34-9539-b7d0802418e0", "name": "network-vif-deleted", "tag": "e9c4cc5e-bace-46c6-b5ad-1295223f054e"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:00.337393 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:00.337393 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:03:00.345965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-7adf21d0-a267-4c28-a92c-08a4205f9502 req-8497f599-9db1-44f3-8d8d-498198e52040 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.346420 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-7adf21d0-a267-4c28-a92c-08a4205f9502 req-8497f599-9db1-44f3-8d8d-498198e52040 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:00.357839 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-7adf21d0-a267-4c28-a92c-08a4205f9502 req-8497f599-9db1-44f3-8d8d-498198e52040 service nova] Creating event network-vif-deleted:e9c4cc5e-bace-46c6-b5ad-1295223f054e for instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 on hv-cinder-81561 Nov 03 02:03:00.363850 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-7adf21d0-a267-4c28-a92c-08a4205f9502 req-8497f599-9db1-44f3-8d8d-498198e52040 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031706 Nov 03 02:03:00.364729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 97/189] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:00.455804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:00.456846 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:00.463829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.464280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:00.465167 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.465692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:00.493326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:00.494020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:00.502504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.503062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:00.504203 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.504902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:00.563276 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c1a8b576-e898-4897-aecc-b487b2451133 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 18155 microversion: 2.20 time: 0.110878 Nov 03 02:03:00.565291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 93/190] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:00 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 18155 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:00.600744 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:00.611168 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d0d36bca-5564-458c-a7bb-8665b6e41987 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1345 microversion: 2.1 time: 0.121675 Nov 03 02:03:00.611774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 98/191] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:00 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:00.843487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:00.844227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:00.852046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.852495 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:00.855249 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:00.855249 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:01.018023 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:01.025913 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3c78253b-53bd-465c-bf84-e951d77aa881 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.186754 Nov 03 02:03:01.035173 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 94/192] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:00 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:01.576979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:01.583234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:01.587967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:01.588891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:01.590018 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:01.590857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:01.628974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:01.629794 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:01.642336 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:01.642802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:01.643611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:01.644035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:01.677424 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:01.677860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:01.678341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lazy-loading 'fault' on Instance uuid 9213a9f9-14dc-4c34-9539-b7d0802418e0 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:03:01.698535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0e0b81fe-9fd9-4b6b-8b22-77db25ed34cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 19342 microversion: 2.20 time: 0.125455 Nov 03 02:03:01.699555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 99/193] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:01 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:01.725621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ea14176dbb45ed9d561cd920cf46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76031e079d5240599980bd51be51f6e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:01.733217 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7bf11791-44ef-4f00-9987-fe65f46fa70b tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 200 len: 1350 microversion: 2.1 time: 0.108945 Nov 03 02:03:01.733779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 95/194] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:01 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:02.043804 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:02.044421 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:02.051277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.051743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.052517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.052953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.194322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:02.201726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ec0d8ca3-a1b4-4a77-ad27-924b16bbbab3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.162026 Nov 03 02:03:02.202311 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 100/195] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:02 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:02.710590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:02.711511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:02.720550 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.720992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.721773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.722417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.772299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:02.772299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:02.777155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.777662 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.778497 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.778935 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.797179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] HTTP exception thrown: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. Nov 03 02:03:02.798655 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Returning 404 to user: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:03:02.799700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d9cd09ee-de86-4699-b39c-9803f8fda516 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 404 len: 111 microversion: 2.1 time: 0.042857 Nov 03 02:03:02.800742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 101/196] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:02 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 02:03:02.805640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8e681d03-2891-403b-a4df-64ac26ac2df2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 21966 microversion: 2.20 time: 0.099265 Nov 03 02:03:02.807102 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 96/197] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:02 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 21966 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:02.909823 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:02.910761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:02.916567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.917010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.917783 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:02.918243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:02.931252 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] HTTP exception thrown: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. Nov 03 02:03:02.931832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Returning 404 to user: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:03:02.932643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5ba2bf52-fa03-47d3-91a5-89b54e03708d tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027089 Nov 03 02:03:02.933174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 102/198] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:03:02 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:03:03.222893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:03.223645 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:03.230589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:03.238928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:03.238928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:03.238928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:03.449068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:03.460011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-25bce479-4a7c-43cc-a1ae-a4c1af3a6e94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.241060 Nov 03 02:03:03.471020 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 97/199] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:03 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:03.818813 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:03.819684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:03.825836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:03.826323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:03.827298 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:03.827726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:03.912434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bb5a9ca9-66a1-4bba-bdb8-fd5203078a85 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 23499 microversion: 2.20 time: 0.097391 Nov 03 02:03:03.913070 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 103/200] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:03 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 23499 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:03:04.362918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:04.364229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:04.370671 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.371311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.372288 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.372714 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.387020 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] HTTP exception thrown: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. Nov 03 02:03:04.387827 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Returning 404 to user: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:03:04.388781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-90891730-1d5f-480c-8e00-e68a615bc3cf tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 404 len: 111 microversion: 2.1 time: 0.029572 Nov 03 02:03:04.389469 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 98/201] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:03:04 2021] DELETE /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:03:04.399176 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:04.400192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] [instance: 9213a9f9-14dc-4c34-9539-b7d0802418e0] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:04.410611 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.411247 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.412803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.414176 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.432871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] HTTP exception thrown: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. Nov 03 02:03:04.433455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] Returning 404 to user: Instance 9213a9f9-14dc-4c34-9539-b7d0802418e0 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:03:04.434477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-204cd84d-1fc7-4d17-bec6-a9bc40b20bb8 tempest-DeleteServersTestJSON-464159370 tempest-DeleteServersTestJSON-464159370-project] 10.222.0.30 "GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0" status: 404 len: 111 microversion: 2.1 time: 0.039775 Nov 03 02:03:04.435014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 104/202] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:04 2021] GET /compute/v2.1/servers/9213a9f9-14dc-4c34-9539-b7d0802418e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:03:04.476816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:04.477432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:04.483211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.483660 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.484433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.485454 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.675524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:04.683253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bdbbb375-2d5b-4ddb-b2d6-3c056dee0440 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.210269 Nov 03 02:03:04.683823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 99/203] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:04 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:04.933026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:04.933971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:04.942041 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.942515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:04.943618 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:04.944055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:05.032563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a930c73d-507c-4e88-9c34-656ce85e9986 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 24923 microversion: 2.20 time: 0.102697 Nov 03 02:03:05.033471 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 105/204] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:04 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 24923 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:05.701010 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:05.701642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:05.707936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:05.708336 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:05.711991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:05.712796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:05.852131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:05.860448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-01397ab4-17cd-4b42-a4bc-d5eed957b36d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.162967 Nov 03 02:03:05.861236 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 100/205] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:05 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:06.045032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:06.046087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:06.053581 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:06.054081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:06.058027 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:06.058855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:06.165234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-da8a2cf5-bc0a-4c4c-8ccb-df6985a67f2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 26034 microversion: 2.20 time: 0.124076 Nov 03 02:03:06.166360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 106/206] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:06 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 26034 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:06.876871 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:06.877481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:06.897856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:06.898336 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:06.899564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:06.900000 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:07.073777 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:07.083698 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fb9c35a5-5ba8-461c-946b-e89aa630bc3d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.209763 Nov 03 02:03:07.085839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 101/207] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:06 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:07.177542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:07.190325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:07.190325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:07.190325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:07.190325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:07.191133 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:07.282541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a9b8f430-eea7-48dd-8b50-639cde17e898 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 26908 microversion: 2.20 time: 0.108548 Nov 03 02:03:07.284127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 107/208] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:07 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 26908 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:08.107609 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:08.108717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:08.124687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:08.125772 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:08.126874 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:08.127364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:08.294261 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:08.295325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:08.306882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:08.307341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:08.308149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:08.309724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:08.315432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:08.334234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ba27df4d-d9a9-4671-99a1-04ceca0c076f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.230791 Nov 03 02:03:08.338058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 102/209] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:08 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:08.437294 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-41b972a2-afb9-4db2-9e45-da7feb151a70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 27401 microversion: 2.20 time: 0.146997 Nov 03 02:03:08.441617 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 108/210] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:08 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 27401 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:09.354558 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:09.355201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:09.361922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:09.362387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:09.363161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:09.363614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:09.449453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:09.451270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:09.465177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:09.468127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:09.469853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:09.470620 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:09.569062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-de320c08-43e2-4a2a-82d8-1a2146770dcf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 27786 microversion: 2.20 time: 0.123379 Nov 03 02:03:09.570069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 109/211] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:09 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 27786 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:09.611579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:09.618914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e8b51eef-a678-4df5-8cf5-83cdc1367b7d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.267937 Nov 03 02:03:09.623759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 103/212] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:09 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:10.544688 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1934761614", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "39d8e720-3276-4c03-8661-79057f0201b2"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:10.585953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:10.587441 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:10.594056 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:10.594790 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:10.595556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:10.596144 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:10.613484 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] validate_networks() for [('39d8e720-3276-4c03-8661-79057f0201b2', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:03:10.692651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-158d0c0f-12c9-4118-bbf3-562154f3bfe5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28130 microversion: 2.20 time: 0.106872 Nov 03 02:03:10.696911 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 104/213] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:10 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28130 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:10.712502 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:10.720190 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:10.759203 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:10.761856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:10.763430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:10.765179 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.047554 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:11.056328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4b8629e0-2195-43bd-b1fd-ce7f1975a9f8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.357504 Nov 03 02:03:11.057373 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 105/214] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:10 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:11.149569 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:03:11.150286 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:03:11.150754 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:03:11.151384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:03:11.151858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:03:11.161034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:11.161478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.162460 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:11.162889 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.179767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Getting quotas for project 2ea66f47ad6c46779bbd1f09bfd5c5be. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:03:11.183703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Getting quotas for user 03863f618f3c4649a8b478f027a14bb1 and project 2ea66f47ad6c46779bbd1f09bfd5c5be. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:03:11.195344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:03:11.197749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:03:11.313465 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1461011991", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "b9f1ba25-c9df-4fb7-a2b7-25e385903abb"}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:11.366260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] validate_networks() for [('b9f1ba25-c9df-4fb7-a2b7-25e385903abb', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:03:11.455506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-811ee1ac-a8bd-4323-8350-826147458ed1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915312 Nov 03 02:03:11.458180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 110/215] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:03:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:03:11.466908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c17a4a38-748d-4da1-9fd5-1ec4f8202b40 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:11.467583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c17a4a38-748d-4da1-9fd5-1ec4f8202b40 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:11.553196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c17a4a38-748d-4da1-9fd5-1ec4f8202b40 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:11.576217 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c17a4a38-748d-4da1-9fd5-1ec4f8202b40 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1214 microversion: 2.1 time: 0.113644 Nov 03 02:03:11.577160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 111/216] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:11 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:11.705375 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:11.715857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:11.715857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:11.715857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.715857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:11.716196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.809549 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-55f96f04-bd01-4d2c-804c-138a71bba4a3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28174 microversion: 2.20 time: 0.108790 Nov 03 02:03:11.810224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 112/217] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:11 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28174 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:11.894247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:03:11.895251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:03:11.896076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:03:11.896255 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:03:11.896761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:03:11.911616 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:11.912169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.913126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:11.913667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:11.933876 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:03:11.942150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for user c920199e7537410989d8118aecfeb6d9 and project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:03:11.955068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:03:11.961973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:03:12.074278 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:12.074965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:12.082685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:12.083107 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:12.083756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:12.084228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:12.114708 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-862fde4d-547e-4300-9d25-a591c467da64 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945733 Nov 03 02:03:12.115527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 106/218] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:03:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 02:03:12.125169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3ebebbcb-7b37-4c3e-9a05-1a958da9d1bd tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:12.125778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3ebebbcb-7b37-4c3e-9a05-1a958da9d1bd tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:12.210305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3ebebbcb-7b37-4c3e-9a05-1a958da9d1bd tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:12.222091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3ebebbcb-7b37-4c3e-9a05-1a958da9d1bd tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1218 microversion: 2.1 time: 0.100368 Nov 03 02:03:12.226505 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 107/219] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:12 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:12.324280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:12.334053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-59251fc6-b087-4ac7-a7fe-3b33757e98d6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.263669 Nov 03 02:03:12.334749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 113/220] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:12 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:12.594601 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-790ac1dc-5f9c-47ae-89ca-df948dad0e27 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:12.595412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-790ac1dc-5f9c-47ae-89ca-df948dad0e27 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:12.654879 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-790ac1dc-5f9c-47ae-89ca-df948dad0e27 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:12.664042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-790ac1dc-5f9c-47ae-89ca-df948dad0e27 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1214 microversion: 2.1 time: 0.074201 Nov 03 02:03:12.674032 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 108/221] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:12 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:12.820777 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:12.821727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:12.828318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:12.828713 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:12.829505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:12.829955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:12.925908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-72be1ec0-72fd-4277-8d5f-2bd806fa75e3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28465 microversion: 2.20 time: 0.108624 Nov 03 02:03:12.926691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 114/222] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:12 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28465 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:13.239794 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3f2d3d87-c6bd-4631-bc38-6ff9e09a7a44 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:13.240581 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3f2d3d87-c6bd-4631-bc38-6ff9e09a7a44 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:13.296105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3f2d3d87-c6bd-4631-bc38-6ff9e09a7a44 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:13.305123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3f2d3d87-c6bd-4631-bc38-6ff9e09a7a44 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1218 microversion: 2.1 time: 0.069206 Nov 03 02:03:13.305933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 109/223] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:13 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:13.353823 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:13.355171 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:13.363150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:13.363815 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:13.364738 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:13.365336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:13.539059 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:13.550310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-370b1da6-ee4b-4aff-b8e0-a1cfb16be2db tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.198595 Nov 03 02:03:13.550310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 115/224] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:13 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:13.680675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:13.681438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:13.688116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:13.688778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:13.689820 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:13.690277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:13.754677 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:13.762451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-87ab03e2-1284-4e90-9336-665336d52570 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1266 microversion: 2.1 time: 0.085316 Nov 03 02:03:13.763230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 110/225] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:13 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:13.936781 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:13.937729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:13.944087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:13.944555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:13.945295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:13.945816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.017785 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c9640d86-8d02-42c0-91c0-e854cb32245e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28465 microversion: 2.20 time: 0.084476 Nov 03 02:03:14.018557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 116/226] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:13 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28465 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:14.322919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:14.324766 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:14.353580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:14.354034 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.354845 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:14.355453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.446109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:14.459339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2ccf01ea-1e63-48db-84e0-27a1225134da tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1270 microversion: 2.1 time: 0.141619 Nov 03 02:03:14.459858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 111/227] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:14 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:14.566233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:14.568426 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:14.577829 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:14.579066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.580704 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:14.581309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.780047 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:14.780665 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:14.786828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:14.787280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.788057 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:14.788490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:14.935618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:14.966084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0cf08601-7c25-4e72-aafe-9b244cfded7a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1272 microversion: 2.1 time: 0.189506 Nov 03 02:03:14.969733 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 112/228] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:14 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:14.998542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:15.026103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5c1017bb-aee9-4d42-9b19-4ab0566208ea tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.464967 Nov 03 02:03:15.029139 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 117/229] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:14 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:15.031894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:15.034116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:15.041826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:15.042509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:15.043301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:15.043732 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:15.137353 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-846dfbf8-f2b5-423b-a466-5a0a76c64257 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28633 microversion: 2.20 time: 0.110825 Nov 03 02:03:15.138682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 113/230] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:15 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28633 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:03:15.478435 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:15.479036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:15.485701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:15.486224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:15.487063 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:15.487532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:15.622804 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:15.636839 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5573bf16-04e1-438a-98ff-2faa74e95ce1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1276 microversion: 2.1 time: 0.161984 Nov 03 02:03:15.640763 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 118/231] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:15 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:15.987729 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:15.988438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:15.995791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:15.996296 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:15.997280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:15.997715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.043777 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:16.045004 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:16.052219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:16.052994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.054222 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:16.054944 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.475519 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:16.484187 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-16a410b8-411c-4b83-b035-975d8c88bab7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.500994 Nov 03 02:03:16.489760 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 114/232] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:15 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:16.494742 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:16.499213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:16.506040 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:16.506843 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.507833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:16.508391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.585366 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:16.595921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dbda7384-3287-42cd-aa42-8aa84d82f90e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.554170 Nov 03 02:03:16.605905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-857de2d9-f9e7-459d-8a68-39456f56346f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28633 microversion: 2.20 time: 0.114511 Nov 03 02:03:16.607938 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 119/234] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:16 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:16.608078 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 115/234] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:16 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28633 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:16.653895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:16.654523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:16.660827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:16.661266 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.662031 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:16.662508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:16.757231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:16.773555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ff824a8e-bdaf-4ee5-aae9-e95608f47c9c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1276 microversion: 2.1 time: 0.123104 Nov 03 02:03:16.774513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 120/235] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:16 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:17.471005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-e0093bd7-92d9-4990-8da8-6cb8f7fd2bf8 req-37b040d9-ec25-4a5f-acd8-9950c698aee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eca92f-b547-4f67-98b3-63d17f454cb3", "tag": "66ee1f9c-8767-42fb-87fc-d738a4b0174c"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:17.473082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:17.473082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:03:17.487342 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e0093bd7-92d9-4990-8da8-6cb8f7fd2bf8 req-37b040d9-ec25-4a5f-acd8-9950c698aee7 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.488226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e0093bd7-92d9-4990-8da8-6cb8f7fd2bf8 req-37b040d9-ec25-4a5f-acd8-9950c698aee7 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:17.501920 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-e0093bd7-92d9-4990-8da8-6cb8f7fd2bf8 req-37b040d9-ec25-4a5f-acd8-9950c698aee7 service nova] Creating event network-changed:66ee1f9c-8767-42fb-87fc-d738a4b0174c for instance 11eca92f-b547-4f67-98b3-63d17f454cb3 on hv-cinder-81561 Nov 03 02:03:17.503019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:17.504819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:17.508017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-e0093bd7-92d9-4990-8da8-6cb8f7fd2bf8 req-37b040d9-ec25-4a5f-acd8-9950c698aee7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041370 Nov 03 02:03:17.509071 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 116/236] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:17.512615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.513743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:17.515837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.516422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:17.618399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:17.619934 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:17.628473 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.629337 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:17.630518 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.631586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:17.964503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:17.972638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-59ccf1f7-c854-47cb-8be0-c3581aa55e22 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.474030 Nov 03 02:03:17.973409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 121/237] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:17 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:17.979799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:17.980300 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:17.988638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.989228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:17.990730 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:17.992288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:18.101136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e11834e6-9a89-411d-ae43-d703fce863ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28633 microversion: 2.20 time: 0.123851 Nov 03 02:03:18.105573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 122/238] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:17 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28633 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:18.118176 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:18.119272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:18.137665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:18.137665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:18.137665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:18.137665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:18.326167 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:18.337902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ac79ae45-163f-4950-b682-24412932b709 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.726660 Nov 03 02:03:18.338594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 117/239] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:17 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:18.827254 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:18.839432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5d2ca3c5-43b1-4653-b6ff-883ed13126b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.735441 Nov 03 02:03:18.840034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 123/240] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:18 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:18.990077 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:18.999217 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:18.999217 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:18.999217 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:18.999217 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:18.999824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.113474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:19.115301 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:19.121666 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.137968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.137968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.137968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.211185 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1507bbcc-2ca3-4fcc-9933-a106062b3b72 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 28984 microversion: 2.20 time: 0.101734 Nov 03 02:03:19.213067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 124/241] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:19 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 28984 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:19.282618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:19.290154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-83d2af3d-ea04-4ce7-ac60-f09db304e22b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.303667 Nov 03 02:03:19.290765 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 118/242] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:18 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:19.357824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:19.358542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:19.367016 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.367866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.368652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.369529 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.542486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-3c5c23d7-86e4-455a-8917-b7ac6cd7f2a2 req-6fe4eb7a-ed54-4f2b-89c8-0c4e045bbcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7ffd60-ded0-4044-8e50-f1acf30e9dfd", "tag": "aef52f3c-1a62-45b5-9c4b-40ee0869774e"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:19.544262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:19.544262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:03:19.551589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-3c5c23d7-86e4-455a-8917-b7ac6cd7f2a2 req-6fe4eb7a-ed54-4f2b-89c8-0c4e045bbcf5 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.552024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-3c5c23d7-86e4-455a-8917-b7ac6cd7f2a2 req-6fe4eb7a-ed54-4f2b-89c8-0c4e045bbcf5 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.570968 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-3c5c23d7-86e4-455a-8917-b7ac6cd7f2a2 req-6fe4eb7a-ed54-4f2b-89c8-0c4e045bbcf5 service nova] Creating event network-changed:aef52f3c-1a62-45b5-9c4b-40ee0869774e for instance df7ffd60-ded0-4044-8e50-f1acf30e9dfd on hv-cinder-81561 Nov 03 02:03:19.591698 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-3c5c23d7-86e4-455a-8917-b7ac6cd7f2a2 req-6fe4eb7a-ed54-4f2b-89c8-0c4e045bbcf5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052606 Nov 03 02:03:19.598690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 119/243] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:03:19.639837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:19.646855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b0fff61e-d058-460a-877b-9f6a457f3e4e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.293307 Nov 03 02:03:19.651653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 125/244] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:19 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:19.858790 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:19.860152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:19.866485 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.867001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:19.867850 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:19.868352 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.015774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:20.023093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8d828429-17db-4be6-b387-398406df2f77 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.169727 Nov 03 02:03:20.027483 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 120/245] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:19 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:20.223318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:20.224333 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:20.230806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:20.231341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.232401 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:20.232909 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.306967 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:20.307688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:20.316541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:20.316977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.318864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:20.320663 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.333784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c7152d09-d13b-4c54-96b0-537cd1abb848 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 30112 microversion: 2.20 time: 0.114048 Nov 03 02:03:20.334599 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 126/246] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:20 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 30112 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:20.545327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:20.554628 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d868c38a-0a74-4100-967c-68534cbdd639 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.251155 Nov 03 02:03:20.555688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 121/247] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:20 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:20.666091 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:20.666954 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:20.673798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:20.674341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.675243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:20.675773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:20.826304 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:20.835810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-48f61c6d-d2cb-4129-a47b-dd93a29a8b94 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.175083 Nov 03 02:03:20.852270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 127/248] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:20 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:21.040755 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:21.041434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:21.051462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.052270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.054593 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.056250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.212560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:21.217870 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5b9e1f7c-a11c-4e97-a1c5-5b079c5b37fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.180905 Nov 03 02:03:21.218556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 122/249] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:21 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:21.345620 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:21.346595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:21.353080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.353532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.354338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.354774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.442305 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9295ddb5-5698-48b9-bf29-e222410f48f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 31028 microversion: 2.20 time: 0.100329 Nov 03 02:03:21.443177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 128/250] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:21 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 31028 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:21.571233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:21.571830 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:21.577325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.577781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.579117 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.579545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.710535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:21.717633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-276fb848-4b47-4d2c-93e8-830d84b42ce4 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.149892 Nov 03 02:03:21.718143 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 123/251] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:21 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:21.854071 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:21.865327 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:21.865327 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.865327 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:21.865327 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:21.865918 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.027177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:22.038790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-340aede5-bf1b-498c-be27-b351a3151ec0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.188920 Nov 03 02:03:22.048299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 129/252] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:21 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:22.234572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:22.235093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:22.241247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:22.241686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.257723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:22.257723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.377887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:22.386212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cab8d96c-23b0-4565-b62c-e6fd94ad83bc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.155278 Nov 03 02:03:22.386792 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 124/253] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:22 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:22.454503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:22.455859 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:22.462453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:22.463010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.463793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:22.464223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.556250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9fb2c229-ca1f-4679-b021-b7faa8d1808a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 32423 microversion: 2.20 time: 0.106390 Nov 03 02:03:22.557163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 130/254] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:22 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 32423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:22.735212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:22.735809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:22.741446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:22.741885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.742682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:22.743130 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:22.893597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:22.901145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-267c5d50-63ac-466a-ab68-cfec74cd04c8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.170039 Nov 03 02:03:22.911361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 125/255] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:22 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:23.057517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:23.058527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:23.072573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.073256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.075565 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.076458 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.233076 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:23.241281 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-744ff56b-ea67-4a3f-a202-6d37070ea3d0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.189044 Nov 03 02:03:23.241859 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 131/256] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:23 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:23.403151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:23.403759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:23.420088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.421862 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.424451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.432943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.569795 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:23.571341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:23.579613 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.580077 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.580874 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.581312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.612631 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:23.624513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3a0c1480-4e21-494d-b67a-1dafd1212130 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.224970 Nov 03 02:03:23.625657 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 126/257] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:23 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:23.670109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1b0e3231-8687-4001-8456-5269c51c0b9c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 33622 microversion: 2.20 time: 0.105276 Nov 03 02:03:23.674377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 132/258] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:23 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 33622 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:23.917729 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:23.918366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:23.924256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.924703 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:23.925474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:23.925902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.096584 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:24.106233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b1beff69-8803-47c6-a35b-ac437e350e55 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.191933 Nov 03 02:03:24.109532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 127/259] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:23 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:24.260009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:24.261104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:24.272360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:24.273144 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.274572 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:24.275216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.444677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:24.452179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6b0f3a09-1833-452f-9ea1-45de3bef6a9d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.197138 Nov 03 02:03:24.452891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 133/260] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:24 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:24.641347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:24.642097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:24.648256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:24.648801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.649639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:24.650203 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.682115 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:24.683040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:24.694322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:24.695054 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.696112 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:24.696700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:24.837007 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:24.847722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6d4b1694-1102-403b-a031-f816c0a284ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.210043 Nov 03 02:03:24.848557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 128/261] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:24 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:24.962174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5bc9a451-f7f3-4e1e-8ddc-bb22d62c2390 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 34454 microversion: 2.20 time: 0.283058 Nov 03 02:03:24.963040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 134/262] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:24 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 34454 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:25.133944 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:25.139123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:25.144547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.144991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.145890 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.146682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.152643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-4c32cd85-1019-4ed5-9bc0-151270a4fc8c req-9e548360-34db-478f-9d43-b0c16b88b268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7ffd60-ded0-4044-8e50-f1acf30e9dfd", "name": "network-vif-plugged", "status": "completed", "tag": "aef52f3c-1a62-45b5-9c4b-40ee0869774e"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:25.155243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:25.155243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:03:25.164974 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-4c32cd85-1019-4ed5-9bc0-151270a4fc8c req-9e548360-34db-478f-9d43-b0c16b88b268 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.165718 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-4c32cd85-1019-4ed5-9bc0-151270a4fc8c req-9e548360-34db-478f-9d43-b0c16b88b268 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.193223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-4c32cd85-1019-4ed5-9bc0-151270a4fc8c req-9e548360-34db-478f-9d43-b0c16b88b268 service nova] Creating event network-vif-plugged:aef52f3c-1a62-45b5-9c4b-40ee0869774e for instance df7ffd60-ded0-4044-8e50-f1acf30e9dfd on hv-cinder-81561 Nov 03 02:03:25.202295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-4c32cd85-1019-4ed5-9bc0-151270a4fc8c req-9e548360-34db-478f-9d43-b0c16b88b268 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054441 Nov 03 02:03:25.203209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 135/263] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:25.335713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:25.349438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-68d766cd-84f0-40ef-bdf9-13e8615eeeb6 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.225601 Nov 03 02:03:25.358971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 129/264] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:25 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:25.470434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:25.471135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:25.477065 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.477513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.478319 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.478755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.626033 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:25.633372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-47e74a67-1d8a-4feb-9005-08e219a9deb8 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.168026 Nov 03 02:03:25.634226 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 136/265] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:25 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:25.870922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:25.872645 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:25.895746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.895746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.895746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.895746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.979885 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:25.982571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:25.991840 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.992293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:25.996765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:25.997309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:26.081304 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:26.090169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-96bd8dfb-05d1-4c1e-9f5d-68d37709370c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.228209 Nov 03 02:03:26.090769 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 130/266] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:25 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:26.366352 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:26.366964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:26.372762 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:26.373206 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:26.373980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:26.374447 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:26.542397 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:26.550558 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-51c872a5-773a-4eba-97e9-d126ae2d3c91 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.187856 Nov 03 02:03:26.551136 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 131/267] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:26 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:26.650439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:26.651143 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:26.658096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:26.658557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:26.659318 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:26.659739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:26.795390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:26.803322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-daca0abe-c285-4967-9129-522d92b02dd2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.156502 Nov 03 02:03:26.803892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 132/268] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:26 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:27.107694 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:27.108303 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:27.115145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.115584 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.116348 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.116770 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.248371 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:27.256055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-608499d7-e25b-441c-85dc-16821278e81d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.152158 Nov 03 02:03:27.256613 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 133/269] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:27 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:27.260803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-ce455610-1c09-4cab-8fb0-8b0c1e58312d req-110be284-6ce8-4d7a-a513-5f145bbc182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eca92f-b547-4f67-98b3-63d17f454cb3", "name": "network-vif-plugged", "status": "completed", "tag": "66ee1f9c-8767-42fb-87fc-d738a4b0174c"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:27.262382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:27.262382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:03:27.269093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-ce455610-1c09-4cab-8fb0-8b0c1e58312d req-110be284-6ce8-4d7a-a513-5f145bbc182d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.271397 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-ce455610-1c09-4cab-8fb0-8b0c1e58312d req-110be284-6ce8-4d7a-a513-5f145bbc182d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.280258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-ce455610-1c09-4cab-8fb0-8b0c1e58312d req-110be284-6ce8-4d7a-a513-5f145bbc182d service nova] Creating event network-vif-plugged:66ee1f9c-8767-42fb-87fc-d738a4b0174c for instance 11eca92f-b547-4f67-98b3-63d17f454cb3 on hv-cinder-81561 Nov 03 02:03:27.284938 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-ce455610-1c09-4cab-8fb0-8b0c1e58312d req-110be284-6ce8-4d7a-a513-5f145bbc182d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027254 Nov 03 02:03:27.285504 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 134/270] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:27.568906 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:27.569778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:27.576102 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.576541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.577294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.577713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.710798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:27.719013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-42fe8988-4a50-4642-9dcb-9e3ee46447c1 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.154232 Nov 03 02:03:27.719822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 135/271] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:27 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:27.820388 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:27.820993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:27.826669 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.827097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.828350 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:27.828826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:27.958801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:27.966031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f3bc5b03-a37f-4f96-bbf5-a95c7b55cf97 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.149232 Nov 03 02:03:27.966620 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 136/272] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:27 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:28.272453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:28.273056 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:28.279227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:28.279668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:28.280426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:28.280854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:28.425658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-61d0f8c7-67b2-471a-ac22-59eab417053a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 36862 microversion: 2.20 time: 2.450168 Nov 03 02:03:28.426401 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 137/273] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:25 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 36862 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:03:28.438650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:28.446327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b0172962-e9f8-4f45-883f-3c198bb3a0e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.177405 Nov 03 02:03:28.447203 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 137/274] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:28 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:28.736508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:28.737433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:28.744292 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:28.744961 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:28.745741 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:28.746190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:28.924832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:28.932068 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fb38cc04-5a46-4665-b8c5-3f3b3ffb7be8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.200223 Nov 03 02:03:28.932668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 138/275] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:28 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:28.982994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:28.983563 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:28.989804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:28.990285 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:28.991050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:28.991477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:29.122668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:29.129828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b0fdcc63-768b-4b04-9a71-3a8140942891 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1523 microversion: 2.1 time: 0.150555 Nov 03 02:03:29.130416 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 138/276] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:28 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:29.438127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:29.439052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:29.445519 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:29.445958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:29.446746 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:29.447172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:29.468974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:29.469588 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:29.475782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:29.476227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:29.476998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:29.477427 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:29.545914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d5021a4d-7ae8-405f-9fbb-abe11b0b643f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 37351 microversion: 2.20 time: 0.111258 Nov 03 02:03:29.546852 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 139/277] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:29 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 37351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:29.605457 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:29.613055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-183bc38d-88a2-4d8a-bfe5-edba466e8bba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1318 microversion: 2.1 time: 0.148279 Nov 03 02:03:29.613625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 139/278] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:29 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:29.949250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:29.949936 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:29.957306 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:29.957748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:29.958690 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:29.959154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.114220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:30.122277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b38a21b2-e35e-4f5a-ac23-0f38c17b79bd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1314 microversion: 2.1 time: 0.176946 Nov 03 02:03:30.122844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 140/279] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:29 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:30.146425 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:30.147035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:30.161954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.162455 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.163254 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.163690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.344265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:30.352753 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-56f6f352-f32c-4fdb-bad6-e5158378892f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1503 microversion: 2.1 time: 0.210049 Nov 03 02:03:30.353626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 140/280] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:30 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:30.408323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:30.408932 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:30.420277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.420721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.421509 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.421995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.557305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:30.558460 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:30.562210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:30.565100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.565547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.566589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.566777 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.569782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1b800bcc-694a-4f99-a885-b0335ca5d66d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1516 microversion: 2.1 time: 0.166442 Nov 03 02:03:30.570387 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 141/281] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:30 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:30.629024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:30.629626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:30.642083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.642083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.642083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:30.642083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:30.691312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ec566012-ab7f-420c-9ab0-b156e813911f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 37921 microversion: 2.20 time: 0.137472 Nov 03 02:03:30.710835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 141/282] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:30 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 37921 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:03:31.008878 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:31.018290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f8ddb051-6646-4cd5-8043-455120e8579a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1509 microversion: 2.1 time: 0.392973 Nov 03 02:03:31.018865 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 142/283] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:30 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:31.043350 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1108315755", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "326aa7e2-8440-4a6d-838b-7bc4586b4583"}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:31.095763 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] validate_networks() for [('326aa7e2-8440-4a6d-838b-7bc4586b4583', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:03:31.141160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:31.141760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:31.149357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:31.150040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:31.151015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:31.151592 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:31.362292 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:31.370193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5235cfa3-d3db-4188-8a89-726c8ce77a4c tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1496 microversion: 2.1 time: 0.233294 Nov 03 02:03:31.370780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 143/284] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:31 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1496 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:31.527769 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:03:31.529651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:03:31.529651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:03:31.529651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:03:31.529651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:03:31.538560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:31.539004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:31.539808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:31.540238 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:31.556863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Getting quotas for project 98a980ad0c18487f84e6b1163bde3249. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:03:31.560700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Getting quotas for user 07503c14bcbe43d292e444271688f56f and project 98a980ad0c18487f84e6b1163bde3249. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:03:31.571700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:03:31.574206 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:03:31.703801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:31.704809 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:31.710623 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:31.711048 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:31.711843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:31.712273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:31.795953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-00c9ca7b-3026-4249-bf76-7372eea1c9d7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 38161 microversion: 2.20 time: 0.096164 Nov 03 02:03:31.796591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 144/285] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:31 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 38161 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:03:31.850392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1ce6173d-20ed-40ac-9b52-915340f80204 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811219 Nov 03 02:03:31.851216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 142/286] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:03:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:03:31.861411 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a5960ec6-75e3-4c3c-af43-b42cfbaabe41 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:31.862251 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a5960ec6-75e3-4c3c-af43-b42cfbaabe41 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:31.924578 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a5960ec6-75e3-4c3c-af43-b42cfbaabe41 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:31.931151 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a5960ec6-75e3-4c3c-af43-b42cfbaabe41 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1219 microversion: 2.1 time: 0.073777 Nov 03 02:03:31.932511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 145/287] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:31 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:32.798271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:32.800404 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:32.807843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:32.808802 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:32.810527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:32.811179 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:32.812386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:32.813032 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:32.818177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:32.818630 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:32.819426 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:32.819855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:32.851224 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lazy-loading 'flavor' on Instance uuid fe6fe0cb-1e19-4f19-84b4-15e0d56010fe {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:03:32.908835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-de52a4e8-ee3d-468a-adb7-04f98c978224 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 38161 microversion: 2.20 time: 0.104626 Nov 03 02:03:32.909765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 146/288] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:32 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 38161 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:32.916788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:32.917643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:32.926092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:32.926571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:32.927365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:32.927797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:32.975063 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:03:33.356874 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-039c9477-a968-443b-8af0-c48060577c66 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "DELETE /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 204 len: 0 microversion: 2.1 time: 0.445465 Nov 03 02:03:33.357761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 147/289] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:03:32 2021] DELETE /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:03:33.365798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:33.365798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:33.369510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.369951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.370756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.371341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.439320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:33.446724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8da9df1d-9109-4082-9384-cf0cb1a4124d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1223 microversion: 2.1 time: 0.087841 Nov 03 02:03:33.447299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 148/290] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:33 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:33.451909 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bec34e8c-3051-47f4-885b-72a823fc777c"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:33.453575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:33.459591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.460150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.460916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.461339 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.480021 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e4b97ab6-5803-44d4-ad9f-de347ef40106 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action" status: 200 len: 32 microversion: 2.1 time: 0.688132 Nov 03 02:03:33.480871 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 143/291] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:03:32 2021] POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action => generated 32 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:03:33.493455 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:33.494145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:33.507253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.507910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.508835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.509720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.697594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:33.705378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-992e4b27-8dbc-4b22-87e8-50a4216caf98 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1502 microversion: 2.1 time: 0.215886 Nov 03 02:03:33.705952 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 144/292] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:33 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:33.716039 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:33.716640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:33.722584 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.723234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.724043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:33.724474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:33.969947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:33.977686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c5e92651-788b-403f-a552-79e8c7f76e86 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.266130 Nov 03 02:03:33.978481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 145/293] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:33 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:33.994123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:33.995784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:34.002763 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.003208 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.004085 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.004519 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.088415 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-be7549b7-239e-408a-8f0f-e11303b65391 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 200 len: 38300 microversion: 2.20 time: 0.098203 Nov 03 02:03:34.089482 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 146/294] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:33 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 38300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:34.100825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:34.102088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:34.109889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.110384 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.111361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.112695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.138374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5aa9726f-348a-4f51-890e-64bc14014f46 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/ips" status: 200 len: 153 microversion: 2.20 time: 0.042851 Nov 03 02:03:34.138964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 147/295] 10.222.0.30 () {60 vars in 1288 bytes} [Wed Nov 3 02:03:34 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:03:34.454241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7ee445e3-5bae-4b0b-af07-fadfa03adb55 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.005330 Nov 03 02:03:34.454945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 149/296] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:03:33 2021] POST /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 194 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:34.464239 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:34.465655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:34.474962 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.475668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.477311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.477914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.579411 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:34.587309 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-85dc73e8-340e-4874-82d0-b9426e42ea20 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1279 microversion: 2.1 time: 0.127019 Nov 03 02:03:34.587877 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 148/297] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:34 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:34.723167 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:34.723899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:34.730069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.742367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.742367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:34.742367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:34.880388 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:34.887784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2a568b38-0dfd-49ad-a81d-0b46e761dc85 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1502 microversion: 2.1 time: 0.169287 Nov 03 02:03:34.892833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 150/298] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:34 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:34.995206 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:34.995802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:35.001994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.002459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.003222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.003647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.284159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:35.291442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e194f8fe-8aa6-4ee1-a535-86bb672e5578 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.299841 Nov 03 02:03:35.292008 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 149/299] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:34 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:35.605760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:35.606551 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:35.614060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.614546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.621895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.621895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.707765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:35.715097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9cef1c16-5011-4c2d-a91d-144a2fde9db3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1277 microversion: 2.1 time: 0.114246 Nov 03 02:03:35.715663 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 151/300] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:35 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:35.853857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-0ccab2db-4a40-4c04-a5c4-914f43ea4948 req-5165f7cb-26cd-4c1a-8d5d-e4c592e533cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eca92f-b547-4f67-98b3-63d17f454cb3", "name": "network-vif-deleted", "tag": "66ee1f9c-8767-42fb-87fc-d738a4b0174c"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:35.853857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:35.853857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:03:35.859686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-0ccab2db-4a40-4c04-a5c4-914f43ea4948 req-5165f7cb-26cd-4c1a-8d5d-e4c592e533cb service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.860381 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-0ccab2db-4a40-4c04-a5c4-914f43ea4948 req-5165f7cb-26cd-4c1a-8d5d-e4c592e533cb service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.871419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-0ccab2db-4a40-4c04-a5c4-914f43ea4948 req-5165f7cb-26cd-4c1a-8d5d-e4c592e533cb service nova] Creating event network-vif-deleted:66ee1f9c-8767-42fb-87fc-d738a4b0174c for instance 11eca92f-b547-4f67-98b3-63d17f454cb3 on hv-cinder-81561 Nov 03 02:03:35.883933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-0ccab2db-4a40-4c04-a5c4-914f43ea4948 req-5165f7cb-26cd-4c1a-8d5d-e4c592e533cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038484 Nov 03 02:03:35.885409 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 150/301] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:35.907246 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:35.908059 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:35.918263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.918263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.918263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:35.918263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:35.990431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:35.998397 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a69b9cb6-84b9-4e53-bc33-dd7a7fb89791 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1460 microversion: 2.1 time: 0.095562 Nov 03 02:03:35.998967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 152/302] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:35 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1460 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:36.308612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:36.309221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:36.315886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:36.316327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:36.317097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:36.317530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:36.448790 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:36.456357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e4d627c8-2acb-4fcf-8c64-e8921430e26f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.151681 Nov 03 02:03:36.456994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 151/303] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:36 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:36.731963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:36.732554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:36.738926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:36.739365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:36.740128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:36.740551 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:36.872028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:36.879199 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e7148c4f-c1a2-4241-acf9-95f02b9516e6 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.150902 Nov 03 02:03:36.879873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 153/304] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:36 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:37.015527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:37.016121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:37.022672 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:37.023111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:37.023869 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:37.024296 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:37.082914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:37.090166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-98261663-44e6-4b4e-8ee6-9d7088758a4a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1299 microversion: 2.1 time: 0.078752 Nov 03 02:03:37.090777 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 152/305] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:37 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1299 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:37.472583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:37.473361 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:37.480095 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:37.480541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:37.481377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:37.481860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:37.614895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:37.622410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e664c90c-53c1-49bb-bb79-dfa31960ea7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.153424 Nov 03 02:03:37.627031 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 154/306] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:37 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:37.896230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:37.904489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:37.910815 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:37.911257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:37.912025 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:37.912453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:38.051713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:38.058824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3adfe5ae-1a3a-4445-8382-109e00967689 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.166401 Nov 03 02:03:38.059377 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 153/307] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:37 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:38.106848 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:38.107475 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:38.113816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:38.114290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:38.115053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:38.115481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:38.172567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:38.179605 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-156f011a-47f4-49a0-8e60-f749e2919b43 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1299 microversion: 2.1 time: 0.076408 Nov 03 02:03:38.180153 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 155/308] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:38 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1299 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:38.639720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:38.640947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:38.646981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:38.647424 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:38.648196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:38.648621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:38.903033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:38.910481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-392d9dd9-93c5-47b0-ab0b-d7af6dac350e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.274333 Nov 03 02:03:38.911158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 154/309] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:38 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:39.079193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:39.079802 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:39.086045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.086522 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.087289 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.087718 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.197054 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:39.198082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:39.205391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.205840 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.206648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.207081 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.239270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.239712 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.240181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lazy-loading 'fault' on Instance uuid 11eca92f-b547-4f67-98b3-63d17f454cb3 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:03:39.325648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:39.333230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6dab86bd-055d-4954-8e3f-46f5ec9481ad tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 200 len: 1304 microversion: 2.1 time: 0.139886 Nov 03 02:03:39.341046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 155/310] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:39 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:39.352478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:39.360272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-62700281-d005-473b-b6b7-b30392b12451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.284645 Nov 03 02:03:39.360916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 156/311] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:39 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:39.593976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-93619726-1880-4c49-a593-a01c4f4528f8 req-f67da889-a613-400c-a2cb-eb57d86020e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90dea4f-ac73-4fbb-b103-80101d052586", "tag": "171a824a-6709-4440-afd6-b8fcfc397fc3"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:39.593976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:39.593976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:03:39.601697 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-93619726-1880-4c49-a593-a01c4f4528f8 req-f67da889-a613-400c-a2cb-eb57d86020e9 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.602104 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-93619726-1880-4c49-a593-a01c4f4528f8 req-f67da889-a613-400c-a2cb-eb57d86020e9 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.616573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-93619726-1880-4c49-a593-a01c4f4528f8 req-f67da889-a613-400c-a2cb-eb57d86020e9 service nova] Creating event network-changed:171a824a-6709-4440-afd6-b8fcfc397fc3 for instance a90dea4f-ac73-4fbb-b103-80101d052586 on hv-cinder-81561 Nov 03 02:03:39.621752 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-93619726-1880-4c49-a593-a01c4f4528f8 req-f67da889-a613-400c-a2cb-eb57d86020e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036248 Nov 03 02:03:39.625869 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 156/312] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:39.927853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:39.928459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:39.934254 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.934727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:39.935502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:39.935934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.163592 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:40.172598 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-caa91a3e-5de8-421c-90b3-173d9330e254 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.246743 Nov 03 02:03:40.172598 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 157/313] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:39 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:40.236981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:40.237855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:40.244069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:40.244604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.245449 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:40.245881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.271519 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lazy-loading 'flavor' on Instance uuid c1203383-0300-4df4-8d34-0d52ac57e83d {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:03:40.351460 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:40.352309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 11eca92f-b547-4f67-98b3-63d17f454cb3] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:40.359807 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:40.361044 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.362033 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:40.362657 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.378669 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] HTTP exception thrown: Instance 11eca92f-b547-4f67-98b3-63d17f454cb3 could not be found. Nov 03 02:03:40.379287 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Returning 404 to user: Instance 11eca92f-b547-4f67-98b3-63d17f454cb3 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:03:40.380288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1109c4ed-5afe-4c22-a805-ecb9908ecdfe tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3" status: 404 len: 111 microversion: 2.1 time: 0.033420 Nov 03 02:03:40.380867 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 158/314] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:40 2021] GET /compute/v2.1/servers/11eca92f-b547-4f67-98b3-63d17f454cb3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:03:40.387040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:40.387853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:40.394634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:40.395404 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.396338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:40.396766 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:40.547780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:40.555689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c458818f-950e-45bc-94ff-7cacdb3d0810 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.173871 Nov 03 02:03:40.556808 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 159/315] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:40 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:40.562539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-80384955", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "39d8e720-3276-4c03-8661-79057f0201b2"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:40.622827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] validate_networks() for [('39d8e720-3276-4c03-8661-79057f0201b2', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:03:41.031865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-62802ddc-291f-40e4-b7c0-16c9febc43f1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 202 len: 0 microversion: 2.20 time: 0.799366 Nov 03 02:03:41.035744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 157/316] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:03:40 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:03:41.040814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:41.041503 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:41.054811 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.055262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.056042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.056476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.235894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:03:41.236417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:03:41.237096 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:03:41.237597 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:03:41.238259 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:03:41.252652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.253101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.253957 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.254603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.271355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:41.282652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:41.282652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:41.282652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6ec8586f-b0e8-42ad-9aec-080af1e1335d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.244832 Nov 03 02:03:41.282951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 158/317] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:41 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:03:41.292157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Getting quotas for project 2ea66f47ad6c46779bbd1f09bfd5c5be. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:03:41.294150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:41.294854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:41.299073 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Getting quotas for user 03863f618f3c4649a8b478f027a14bb1 and project 2ea66f47ad6c46779bbd1f09bfd5c5be. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:03:41.319774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:03:41.319863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.319863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.319863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.319863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.320516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:03:41.433511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-68a35062-78d5-40cc-b8ff-d854a1d4f576 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874882 Nov 03 02:03:41.439399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 160/318] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:03:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:03:41.445169 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-98a19839-48b7-4b1e-ac5c-4f4d8e64b105 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:41.445701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-98a19839-48b7-4b1e-ac5c-4f4d8e64b105 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:41.456042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:41.464752 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-db390116-7882-4e9b-8b70-6ec924cbe380 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.181377 Nov 03 02:03:41.465489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 159/319] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:41 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:41.513985 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-98a19839-48b7-4b1e-ac5c-4f4d8e64b105 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:41.520520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-98a19839-48b7-4b1e-ac5c-4f4d8e64b105 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1212 microversion: 2.1 time: 0.079322 Nov 03 02:03:41.521121 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 161/320] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:41 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:41.576171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:41.576171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:41.580287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.580800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.587032 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:41.587598 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:41.723255 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:41.730562 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5f82a2f3-fd34-47b5-86f6-8ee223861ddc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.161287 Nov 03 02:03:41.731161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 160/321] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:41 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:42.300202 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:42.300800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:42.307524 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.307968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.308882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.309241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.451902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:42.460190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:42.461681 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:42.462855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f5cd459f-f8b2-45da-a7df-ed74fc83c446 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.166386 Nov 03 02:03:42.463405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 162/322] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:42 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:42.481947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:42.482585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:42.489685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.492569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.492569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.492569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.538126 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:42.538869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:42.545577 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.546748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.547700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.548283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.622911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:42.630631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3e7708c1-862a-4ffe-bd26-43fc44b14fc0 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1216 microversion: 2.1 time: 0.096371 Nov 03 02:03:42.631694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 163/323] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:42 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:42.681650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:42.689537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c492f0e9-78ad-46d5-a3b4-4b205870f8b1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.211333 Nov 03 02:03:42.690107 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 161/324] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:42 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:42.748108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:42.748757 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:42.754511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.754956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.755720 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:42.756152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:42.929422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:42.940513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-54f5fefb-c5a5-4acf-8bc3-a6e75d3331f8 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.196004 Nov 03 02:03:42.941353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 164/325] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:42 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:43.480699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:43.481298 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:43.488009 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.488634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.489201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.489633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.636662 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:43.645399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:43.646908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:43.647403 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:43.647583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:43.648101 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f602bdff-8ceb-46bd-bb4e-7dfd49422fb7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.171288 Nov 03 02:03:43.648649 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 162/326] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:43 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:43.654123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.654601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.655400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.655830 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.708409 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:43.710295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:43.722001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.722757 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.723702 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.724283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.748150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:43.758329 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-20152fcf-d5e6-4366-9704-c804cf36aaa7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1264 microversion: 2.1 time: 0.115211 Nov 03 02:03:43.762828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 165/327] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:43 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1264 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:43.874058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:43.882325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cd537642-724c-45e4-bed9-2ac322f41bc6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.178959 Nov 03 02:03:43.883047 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 163/328] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:43 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:43.958648 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:43.960393 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:43.966535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.967297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:43.968342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:43.968862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:44.237277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:44.249784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8ad88697-264b-41ad-b909-15f5cdb77581 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.294742 Nov 03 02:03:44.259441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 166/329] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:43 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:44.665909 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:44.666687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:44.672940 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:44.673408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:44.674398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:44.674824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:44.781502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:44.782801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:44.789170 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:44.789908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:44.791675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:44.792307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:44.957824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:44.965603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:44.967361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:44.968522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-90e5ed90-31cb-4cc6-aeb9-1b712e0f984a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.306269 Nov 03 02:03:44.969073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 164/330] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:44 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:44.984756 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:44.986113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:44.993212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:44.993883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:44.995098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:44.995252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:45.024697 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:45.037138 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4a3fdaa8-130f-4a7a-9b3c-d29effc99821 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.260750 Nov 03 02:03:45.038040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 167/331] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:44 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:45.267025 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:45.267988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:45.274715 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:45.275384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:45.276652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:45.277159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:45.314809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:45.325175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b735b8e4-e708-4b51-983d-7a543a0358c4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.354731 Nov 03 02:03:45.328438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 165/332] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:44 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:45.350026 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-052b9e92-6119-47a6-af5e-4754c16fa02f req-5ecbd625-f713-48a6-a1eb-3d0ccf1c412d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90dea4f-ac73-4fbb-b103-80101d052586", "name": "network-vif-plugged", "status": "completed", "tag": "171a824a-6709-4440-afd6-b8fcfc397fc3"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:45.353456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:45.353456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:03:45.361262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-052b9e92-6119-47a6-af5e-4754c16fa02f req-5ecbd625-f713-48a6-a1eb-3d0ccf1c412d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:45.361795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-052b9e92-6119-47a6-af5e-4754c16fa02f req-5ecbd625-f713-48a6-a1eb-3d0ccf1c412d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:45.373068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-052b9e92-6119-47a6-af5e-4754c16fa02f req-5ecbd625-f713-48a6-a1eb-3d0ccf1c412d service nova] Creating event network-vif-plugged:171a824a-6709-4440-afd6-b8fcfc397fc3 for instance a90dea4f-ac73-4fbb-b103-80101d052586 on hv-cinder-81561 Nov 03 02:03:45.382006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-052b9e92-6119-47a6-af5e-4754c16fa02f req-5ecbd625-f713-48a6-a1eb-3d0ccf1c412d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036175 Nov 03 02:03:45.383520 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 166/333] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:45.613127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:45.620785 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-30ceae90-4a49-44fa-94ce-d3dc7308ff6a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.357476 Nov 03 02:03:45.621442 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:45 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:45.988363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:45.989693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:45.997814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:45.998537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:45.999570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.000273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.058111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:46.058733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:46.065727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.066432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.067384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.068010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.383960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:46.399091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:46.401707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:46.404085 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-acc61528-769f-49a6-98a4-dca1d52dae18 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.420735 Nov 03 02:03:46.406662 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 167/335] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:45 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:46.424538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:46.425265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:46.434268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.434875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.436216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.437652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.482515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:46.497029 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ee09ccd9-f556-49f7-83e7-605c62b96d6a tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.442455 Nov 03 02:03:46.498265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 169/336] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:46 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:46.503596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-7d86dc95-d973-4025-959d-694efed0000d req-9ae59a40-ca66-4ae4-8cac-da769a8f9f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4183b-6728-4119-b616-29bb8384c8d4", "tag": "c401d594-da88-49b7-9fee-e3f764425f67"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:46.514866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:03:46.514866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:03:46.526326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-7d86dc95-d973-4025-959d-694efed0000d req-9ae59a40-ca66-4ae4-8cac-da769a8f9f56 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.526774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-7d86dc95-d973-4025-959d-694efed0000d req-9ae59a40-ca66-4ae4-8cac-da769a8f9f56 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.537854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-7d86dc95-d973-4025-959d-694efed0000d req-9ae59a40-ca66-4ae4-8cac-da769a8f9f56 service nova] Creating event network-changed:c401d594-da88-49b7-9fee-e3f764425f67 for instance 51b4183b-6728-4119-b616-29bb8384c8d4 on hv-cinder-81561 Nov 03 02:03:46.547986 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-7d86dc95-d973-4025-959d-694efed0000d req-9ae59a40-ca66-4ae4-8cac-da769a8f9f56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048256 Nov 03 02:03:46.551511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 170/337] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:03:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:03:46.640460 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:46.641736 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:46.650315 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.651224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.652611 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:46.653252 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:46.673145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:46.683396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b3ab4259-c44c-449f-b7a5-9c78f253eb77 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.263349 Nov 03 02:03:46.684131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 168/338] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:46 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:47.282205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:47.289666 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-35f17989-a4df-4ef7-932b-053976f8d080 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1319 microversion: 2.1 time: 0.654842 Nov 03 02:03:47.297601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 171/339] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:46 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:47.325489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-423800358", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "b9f1ba25-c9df-4fb7-a2b7-25e385903abb"}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:47.424724 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] validate_networks() for [('b9f1ba25-c9df-4fb7-a2b7-25e385903abb', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:03:47.425391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:47.426232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:47.433509 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:47.438658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:47.439824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:47.440427 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:47.919302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:47.932851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:47.932851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:47.932851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1f6ef921-ba73-4a05-b732-e0dc8ce61c3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.510744 Nov 03 02:03:47.933198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 172/340] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:47 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:47.948260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:47.949108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:47.955773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:47.956471 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:47.957255 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:47.957689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:48.571215 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:48.582493 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ffc540f7-6ef6-4dbf-bbf5-9bcc5c788bca tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.635610 Nov 03 02:03:48.592402 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 173/341] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:47 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:48.595934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:48.596554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:48.604914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:48.605276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:48.606064 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:48.606536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:48.621697 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:03:48.631843 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:03:48.632502 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:03:48.637126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:03:48.637632 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:03:48.661273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:48.662028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:48.662768 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:48.663195 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:48.682950 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:03:48.690165 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for user c920199e7537410989d8118aecfeb6d9 and project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:03:48.707013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:03:48.711680 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:03:48.897213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:48.903218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ea39ddaf-c882-49d1-b1a5-52017f435894 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582280 Nov 03 02:03:48.904846 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 169/342] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:03:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 02:03:48.909487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:48.910488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:48.916474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-eaefa233-3d41-4061-a1ed-fb1c4de80a09 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.330418 Nov 03 02:03:48.926926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 174/343] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:48 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:48.935680 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-652a52e3-71e5-423e-9c63-44a340e18b37 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:48.938018 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-652a52e3-71e5-423e-9c63-44a340e18b37 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:48.955536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:48.957692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:48.962744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:48.962744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:49.032719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-652a52e3-71e5-423e-9c63-44a340e18b37 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:49.045310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-652a52e3-71e5-423e-9c63-44a340e18b37 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1217 microversion: 2.1 time: 0.124661 Nov 03 02:03:49.054182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 175/344] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:48 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:49.067169 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:49.068602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:49.076995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:49.077699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:49.078705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:49.079423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:49.318344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:49.324977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-aa0c247f-47aa-485c-ac40-19341dc3c21a tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1506 microversion: 2.1 time: 0.419015 Nov 03 02:03:49.326028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 170/345] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:48 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:49.488676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:49.497659 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:49.500952 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:49.506886 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8b13f4b6-f86c-4ff9-853a-940c5eb5d970 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.458253 Nov 03 02:03:49.513245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 176/346] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:49 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:49.603155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:49.603811 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:49.609927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:49.610395 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:49.611177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:49.611615 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:49.935102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:49.935868 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:49.942975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:49.943496 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:49.944350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:49.944783 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:50.151171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:50.162507 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d955e85b-5bca-4e8f-bdcc-3404dbfc9072 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.565324 Nov 03 02:03:50.172686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 171/347] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:49 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:50.179533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-904ff659-975d-46b2-b2b4-2dc278692467 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:50.179533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-904ff659-975d-46b2-b2b4-2dc278692467 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:50.266608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-904ff659-975d-46b2-b2b4-2dc278692467 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:50.273187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:50.274291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-904ff659-975d-46b2-b2b4-2dc278692467 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1217 microversion: 2.1 time: 0.100237 Nov 03 02:03:50.275674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 172/348] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:50 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:50.292584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6d1d657f-2f7c-4b3a-b714-15ab72f4376d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.361378 Nov 03 02:03:50.302793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 177/349] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:49 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:50.529839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:50.530828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:50.545517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:50.546550 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:50.554705 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:50.554705 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:50.683622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:50.704224 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:50.705706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:50.706882 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-51d8379a-972a-419b-9657-bf125254c5f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.180749 Nov 03 02:03:50.707432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 173/350] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:50 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:51.179539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:51.180136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:51.186457 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.190419 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.190419 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.190419 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.292955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:51.294423 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:51.305600 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.306709 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.308259 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.311244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.443550 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:51.453736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-844ceb16-e9e7-4de7-87eb-69c57446173b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1269 microversion: 2.1 time: 0.165788 Nov 03 02:03:51.455006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 174/351] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:51 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:51.460523 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:51.461338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:51.468152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.471399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.471399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.471399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.492415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:51.500858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7ce27c95-a9a9-41b1-a70f-7a9b77adf0e7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.324847 Nov 03 02:03:51.502030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 178/352] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:51 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:51.638409 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:51.646576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-40c88692-23c3-4bc8-9b2e-7ee8e5e93171 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.190051 Nov 03 02:03:51.647277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 175/353] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:51 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:51.726626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:51.727243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:51.740488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.740827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.755901 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:51.757651 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:51.898725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:51.913977 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:51.916193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:51.917694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f23d25fe-9e46-4a39-9694-a96055028398 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.194670 Nov 03 02:03:51.918347 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 179/354] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:51 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:52.471618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:52.472164 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:52.497214 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:52.497925 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:52.502157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:52.502157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:52.518648 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:52.519770 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:52.536658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:52.548726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:52.549459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:52.549893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:52.792716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:52.816816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7e5376dc-be73-4bd2-a442-849003a8ac57 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1287 microversion: 2.1 time: 0.348706 Nov 03 02:03:52.817650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 176/355] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:52 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1287 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:52.830725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:52.832079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:52.844723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:52.855580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:52.857268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:52.871252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.067310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:53.077249 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bcf793df-e3e0-41a8-a07e-42d4b28daf2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.562920 Nov 03 02:03:53.077811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 180/356] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:52 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:53.089973 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:53.094834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:53.130220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.130220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.132710 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.133143 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.379956 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:53.392101 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-18d65d4c-5dcb-49da-a6ca-304c53bfbd2c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1502 microversion: 2.1 time: 0.572673 Nov 03 02:03:53.393114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 177/357] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:52 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1502 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:53.411729 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ed41dd8-da96-4ef4-a322-3be56916ac85"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:53.413728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:53.421074 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.421969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.423363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.423806 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.461710 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] HTTP exception thrown: Cannot 'attach_volume' instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe while it is in vm_state rescued Nov 03 02:03:53.462583 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Returning 409 to user: Cannot 'attach_volume' instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe while it is in vm_state rescued {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:03:53.469241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4e436755-e16a-4afd-81e7-8774735e02a2 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058744 Nov 03 02:03:53.469241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 178/358] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:03:53 2021] POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 02:03:53.474126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:03:53.474826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:53.479460 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:53.481297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.481986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.483005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.483681 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.488448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:53.489970 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:53.491216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c9ee23a4-2721-4cd2-953c-5d1e76e0d2c7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1745 microversion: 2.20 time: 0.407980 Nov 03 02:03:53.491821 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 181/359] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:53 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1745 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:53.744173 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a548a86a-2480-4b03-9ffb-1b3be86cf6d1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action" status: 202 len: 0 microversion: 2.1 time: 0.274557 Nov 03 02:03:53.745358 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 179/360] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:03:53 2021] POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:03:53.753889 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:53.755155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:53.769825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.770503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.772057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.775452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.835135 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:53.836119 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:53.843594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.859795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:53.859795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:53.859795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:54.143944 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:54.153429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:54.160805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1d72aa29-b342-4605-b754-9ddfff0b4114 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.329475 Nov 03 02:03:54.162969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 180/361] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:53 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:54.168552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-07ab8cc4-3862-47de-94fe-bbe95a2b299d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1510 microversion: 2.1 time: 0.418276 Nov 03 02:03:54.169129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 182/362] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:53 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:54.178344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:54.178344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:54.184905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:54.185519 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:54.187788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:54.188207 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:54.343289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:54.352049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-aad17a9e-6cda-4296-ac75-a5c459a01b2e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.187978 Nov 03 02:03:54.362583 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 181/363] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:54 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:54.520861 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:54.521488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:54.527731 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:54.528180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:54.529302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:54.529917 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:54.699262 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:54.707087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:54.708515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:54.709640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ad25b8fa-bb3b-42bd-abdc-17420a0633d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1745 microversion: 2.20 time: 0.192627 Nov 03 02:03:54.710214 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 183/364] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:54 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:03:55.177619 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:55.178259 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:55.185576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.187162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.188125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.188994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.197862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:55.198609 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:55.205833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.206318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.207104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.207539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.480462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:55.485382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:55.492025 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-961f891a-6c9b-4090-911d-58cb514dec4b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.318030 Nov 03 02:03:55.492976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 182/365] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:55 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:55.493908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b9b9e29d-023f-4231-afb8-bd90fd289094 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1510 microversion: 2.1 time: 0.299632 Nov 03 02:03:55.494496 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 184/366] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:55 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:03:55.498053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:55.498776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:55.504718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.505405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.506299 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.506798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.729208 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:55.730179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:55.737547 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.738034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.738857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:55.739474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:55.962385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:55.973706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c36417fb-10a0-4777-a09f-27de21a33d2b tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.479488 Nov 03 02:03:55.983816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 183/367] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:55 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:55.987847 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:56.004038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:56.007347 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:56.009548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d4139529-c47b-46d3-9833-1cedf4925375 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1745 microversion: 2.20 time: 0.284832 Nov 03 02:03:56.010594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 185/368] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:55 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1745 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:03:56.510734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:56.511283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:56.511635 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:56.511714 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:56.518922 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:56.519278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:56.519524 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:56.519810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:56.520316 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:56.520570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:56.520779 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:56.521240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:56.754225 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:56.762316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:56.762613 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6914cd82-8678-4879-892f-92dd86e37282 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1510 microversion: 2.1 time: 0.255383 Nov 03 02:03:56.763299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 186/369] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:56 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:56.770663 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7fab3bab-61af-43b3-bea8-53ee6115a5ff tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.265860 Nov 03 02:03:56.771224 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 184/370] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:56 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:56.990413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:56.991159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:56.997897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.006978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.006978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.006978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.043899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:57.052717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:57.052717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.052717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.052717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.053302 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.582308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:57.589858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f1295791-9f11-45cc-bdd5-8f9fe929e8ae tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.603108 Nov 03 02:03:57.594895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 187/371] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:56 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:57.775960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:57.781124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:57.781945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:57.792829 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.793749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.794788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.795384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.796408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:57.800538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:57.804362 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b06fc389-a596-4ca8-84e5-c2ca84ad294f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1745 microversion: 2.20 time: 0.764342 Nov 03 02:03:57.806091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 185/372] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:57 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1745 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:03:57.821710 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:57.828634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:57.837831 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.839851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:57.842272 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:57.847772 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:58.542404 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:58.554200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fe553131-6cf0-4751-b96d-58932ca51657 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1510 microversion: 2.1 time: 0.777292 Nov 03 02:03:58.555038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 188/373] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:57 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:58.622931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:03:58.623144 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:58.624774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:58.642652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2987bd0b-298d-438c-9dfa-b13ec803c7ce tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.833306 Nov 03 02:03:58.643586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 186/374] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:57 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:03:58.666648 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:58.675147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:58.676204 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:58.680722 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:58.823839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:03:58.824392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:03:58.833163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:58.834834 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:03:58.837280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:03:58.839813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.035619 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:00.050324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-773c4957-fe2a-48ec-b0d5-281b4270de78 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 1.440755 Nov 03 02:04:00.051119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 189/375] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:03:58 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:00.059914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:00.074560 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:00.076726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:00.076887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:00.078664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:00.083620 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f227c5d5-3745-4746-a791-9a50a1cac329 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 1.263896 Nov 03 02:04:00.084210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 187/376] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:03:58 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:00.087966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:00.088416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.089384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:00.089816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.099652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:00.100833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:00.109385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:00.110821 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.112168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:00.114682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.585149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:00.594690 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3bd92dfd-552b-4b7e-ad35-7c75ac357517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1510 microversion: 2.1 time: 0.531679 Nov 03 02:04:00.606601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 190/377] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:00 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:00.620841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-d1a34805-f884-4a0a-afd0-61cb51ea1fd5 req-302be788-5dc9-4e66-972f-5dd6be612b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "name": "network-vif-plugged", "status": "completed", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:00.624189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:00.624189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:04:00.635323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d1a34805-f884-4a0a-afd0-61cb51ea1fd5 req-302be788-5dc9-4e66-972f-5dd6be612b13 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:00.636561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d1a34805-f884-4a0a-afd0-61cb51ea1fd5 req-302be788-5dc9-4e66-972f-5dd6be612b13 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.665337 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-d1a34805-f884-4a0a-afd0-61cb51ea1fd5 req-302be788-5dc9-4e66-972f-5dd6be612b13 service nova] Creating event network-vif-plugged:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:04:00.677627 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-d1a34805-f884-4a0a-afd0-61cb51ea1fd5 req-302be788-5dc9-4e66-972f-5dd6be612b13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068266 Nov 03 02:04:00.679706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 191/378] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:00.702623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:00.712608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d420b914-3b1e-4ef7-8441-36cf6a1ee84b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.616173 Nov 03 02:04:00.728234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 188/379] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:00 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:00.741269 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-0595a39f-67f5-4160-b916-edadde7409b7 req-26f97846-1bcf-4232-881f-4d621151a688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea", "tag": "b86f86db-8a25-4da3-abaa-8e726628e287"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:00.743191 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:00.743191 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:04:00.752691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-0595a39f-67f5-4160-b916-edadde7409b7 req-26f97846-1bcf-4232-881f-4d621151a688 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:00.753405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-0595a39f-67f5-4160-b916-edadde7409b7 req-26f97846-1bcf-4232-881f-4d621151a688 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:00.772252 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-0595a39f-67f5-4160-b916-edadde7409b7 req-26f97846-1bcf-4232-881f-4d621151a688 service nova] Creating event network-changed:b86f86db-8a25-4da3-abaa-8e726628e287 for instance ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea on hv-cinder-81561 Nov 03 02:04:00.789768 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-0595a39f-67f5-4160-b916-edadde7409b7 req-26f97846-1bcf-4232-881f-4d621151a688 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058175 Nov 03 02:04:00.791998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 192/380] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:01.068854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:01.070106 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:01.092093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:01.094084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:01.094084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:01.094353 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:01.102217 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:01.102988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:01.112639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:01.113097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:01.113898 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:01.117205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:02.269975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:02.279773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:02.285680 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:02.291829 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-561bb283-abe3-497b-b3fa-76c73c02fad9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 1.189322 Nov 03 02:04:02.292805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 193/381] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:01 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:02.299230 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:02.300140 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:02.311582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:02.315456 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:02.316239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:02.325576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-051404ea-d89e-4269-9e6f-8ae61c2a2d57 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 1.261087 Nov 03 02:04:02.327358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:02.331894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:02.334382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 189/382] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:01 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:02.351493 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:02.352066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:02.380779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:02.390720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:02.392013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:02.392691 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:02.899606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:02.930890 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cf26ff09-9f8c-4600-bd4f-8fef06d47d99 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1516 microversion: 2.1 time: 0.629601 Nov 03 02:04:02.931958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 194/383] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:02 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:02.941342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-add9d12e-6c20-4ee3-ac58-952d269aad36 req-a930a6c1-462c-41da-aeb4-28564b7a29de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b4183b-6728-4119-b616-29bb8384c8d4", "name": "network-vif-plugged", "status": "completed", "tag": "c401d594-da88-49b7-9fee-e3f764425f67"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:02.960211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:02.960211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:04:02.976952 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-add9d12e-6c20-4ee3-ac58-952d269aad36 req-a930a6c1-462c-41da-aeb4-28564b7a29de service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:02.977701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-add9d12e-6c20-4ee3-ac58-952d269aad36 req-a930a6c1-462c-41da-aeb4-28564b7a29de service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:03.015863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:03.039317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c7300589-2ce5-48df-bbd5-ec8d3568b1c1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.693501 Nov 03 02:04:03.048749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 190/384] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:02 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:03.055461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-add9d12e-6c20-4ee3-ac58-952d269aad36 req-a930a6c1-462c-41da-aeb4-28564b7a29de service nova] Creating event network-vif-plugged:c401d594-da88-49b7-9fee-e3f764425f67 for instance 51b4183b-6728-4119-b616-29bb8384c8d4 on hv-cinder-81561 Nov 03 02:04:03.064498 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-add9d12e-6c20-4ee3-ac58-952d269aad36 req-a930a6c1-462c-41da-aeb4-28564b7a29de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131023 Nov 03 02:04:03.065182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 195/385] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:03.317919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:03.318762 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:03.324683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:03.325129 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:03.325906 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:03.326394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:03.352005 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:03.384239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:03.384239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:03.384239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:03.384239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:03.384736 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:03.598982 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:03.606935 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:03.608678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:03.609910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-567aefc7-da65-44d1-9b1d-dd3ae7e6c5fd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.296396 Nov 03 02:04:03.610885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 191/386] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:03 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:03.614127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:03.632728 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-980a2390-5154-4085-a816-f5015b2b83b7 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.283128 Nov 03 02:04:03.642032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 196/387] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:03 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:04.057162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:04.057777 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:04.077178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:04.077717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:04.078489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:04.078917 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:04.338492 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:04.348101 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0dabb0b1-4693-42bc-a212-d43ad3fc175c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.295283 Nov 03 02:04:04.351493 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 192/388] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:04 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:04.633019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:04.633774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:04.648421 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:04.649413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:04.655718 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:04.658654 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:04.659393 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:04.660500 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:04.661322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:04.662006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:04.663038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:04.667709 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:04.958429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:04.967264 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:04.973731 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:04.975175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-29ea9bb6-0a78-4874-ae51-053e36e06d5a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.348456 Nov 03 02:04:04.975950 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 197/389] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:04 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:05.007453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:05.015470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-962f315e-805b-44bc-b2fd-ae07684b2bcd tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1312 microversion: 2.1 time: 0.370561 Nov 03 02:04:05.016599 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 193/390] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:04 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1312 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:05.131711 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:05.132377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:05.141912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:05.142902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:05.143693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:05.144271 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:05.373195 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:05.373849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:05.374694 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:05.381222 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f9e6a654-9cd8-4d0e-a37d-218400206355 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1516 microversion: 2.1 time: 0.255292 Nov 03 02:04:05.381776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:05.392832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 198/391] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:05 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:05.394683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:05.399723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:05.399723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:05.399921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f234c42a-649a-4565-9799-2f5a6af3a43f"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:05.399921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:05.411812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:05.412272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:05.413062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:05.413512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:05.696245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:05.703644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8a21df49-e1c9-493c-92b1-37c9097e247b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.339931 Nov 03 02:04:05.713742 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 194/392] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:05 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:05.993455 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:05.994066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:06.002037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:06.002522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:06.005809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:06.008260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:06.247355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:06.258611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:06.260413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:06.261852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bbb44dea-f8d0-4dba-86bd-4e6b41289959 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.272423 Nov 03 02:04:06.279011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 195/393] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:05 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:06.287403 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:06.288307 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:06.300882 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:06.301808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:06.302770 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:06.310409 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:06.626884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-005e3c6e-6753-42fd-8376-e5ddfebbc001 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.229160 Nov 03 02:04:06.631795 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 199/394] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:04:05 2021] POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments => generated 194 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:04:06.644804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:06.656787 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d5160c4d-ab00-4ecf-9d5b-bd68d0431f77 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1494 microversion: 2.1 time: 0.376096 Nov 03 02:04:06.660608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 196/395] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:06 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1494 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:06.721996 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:06.722683 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:06.735238 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:06.735695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:06.737452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:06.737899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:07.164146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:07.180010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ccac54a2-31d1-426b-a258-1ab6a34f7c34 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.462622 Nov 03 02:04:07.181272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 200/396] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:06 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:07.293404 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:07.294477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:07.305162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:07.305798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:07.307023 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:07.307642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:07.504535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:07.513180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:07.528759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:07.528759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9c836ef0-52f2-4731-b05e-b99fb8be6706 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.232085 Nov 03 02:04:07.528759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 197/397] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:07 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:08.200055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:08.202296 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:08.210035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:08.214544 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:08.216791 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:08.222205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:08.439319 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:08.448779 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-78726cdf-7192-4acb-88ca-310fee034f8d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.252287 Nov 03 02:04:08.449822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 201/398] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:08 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:08.535678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:08.537231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:08.544805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:08.548437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:08.548437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:08.548437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:08.696941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:08.697962 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:08.717691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:08.719118 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:08.720293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:08.721496 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:08.793494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:04:08.921001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:09.038257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:09.038257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:09.038257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f5fd1427-e019-4eeb-bd2b-ebd695a35456 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.438261 Nov 03 02:04:09.041120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 198/399] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:08 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:09.468326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:09.469544 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:09.476078 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:09.476649 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:09.480654 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:09.481478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:09.667347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:09.680170 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cd63a358-e6f1-4c1f-b87e-49e964b200a5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.216310 Nov 03 02:04:09.681033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 199/400] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:09 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:10.012175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:10.013344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:10.039151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:10.039807 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:10.040768 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:10.041354 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:10.239278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:10.247934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6753445c-e389-4bcb-8d35-601cf8c41fb2 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 204 len: 0 microversion: 2.1 time: 1.555421 Nov 03 02:04:10.253384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 202/401] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:04:08 2021] DELETE /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 0 bytes in 1558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:04:10.263463 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:10.267306 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:10.272138 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:10.276262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:10.278398 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:10.280659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e3c54a12-9c9e-4747-ba5d-ff9b40153579 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.284590 Nov 03 02:04:10.281342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:10.282430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:10.291538 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:10.293093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 200/402] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:09 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:10.602635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:10.610862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7d3d488d-fbbc-4888-b961-27002762139e tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1500 microversion: 2.1 time: 0.355803 Nov 03 02:04:10.611470 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 203/403] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:10 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1500 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:10.700196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:10.700798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:10.725271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:10.725271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:10.725271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:10.725271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:10.738292 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-516574364", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:11.059785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:11.067736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-86bd6c72-45b9-424b-a91f-3087d5759a67 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.373466 Nov 03 02:04:11.070607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 201/404] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:10 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:11.079358 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-f91bbbff-e5e8-4ebc-8a49-35ee6fcf9aa3 req-57d9eaf1-796e-42a1-8c37-b0470e6c77bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea", "name": "network-vif-plugged", "status": "completed", "tag": "b86f86db-8a25-4da3-abaa-8e726628e287"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:11.091708 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:11.091708 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:04:11.099939 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-f91bbbff-e5e8-4ebc-8a49-35ee6fcf9aa3 req-57d9eaf1-796e-42a1-8c37-b0470e6c77bb service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:11.107761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-f91bbbff-e5e8-4ebc-8a49-35ee6fcf9aa3 req-57d9eaf1-796e-42a1-8c37-b0470e6c77bb service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:11.129633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-f91bbbff-e5e8-4ebc-8a49-35ee6fcf9aa3 req-57d9eaf1-796e-42a1-8c37-b0470e6c77bb service nova] Creating event network-vif-plugged:b86f86db-8a25-4da3-abaa-8e726628e287 for instance ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea on hv-cinder-81561 Nov 03 02:04:11.142608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-f91bbbff-e5e8-4ebc-8a49-35ee6fcf9aa3 req-57d9eaf1-796e-42a1-8c37-b0470e6c77bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065492 Nov 03 02:04:11.143293 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 202/405] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:11.307702 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:11.308711 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:11.318073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:11.324162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:11.327951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:11.328639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:11.667457 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:11.683623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:11.691259 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:11.694621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-70e041c4-8caf-426c-b8bd-2711a49ad0cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.397289 Nov 03 02:04:11.714355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 203/406] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:11 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:11.726526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:11.727992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:11.741432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:11.751691 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:11.752967 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:11.763960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:12.082031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:12.095123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cead749c-9f1f-4355-b1a2-cc01f29f9903 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1500 microversion: 2.1 time: 0.377088 Nov 03 02:04:12.097107 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 204/407] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:11 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1500 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:12.101672 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:12.102320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:12.108352 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:12.108803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:12.109591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:12.110030 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:12.348139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:12.361381 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-40e51dd7-c9aa-44d0-bb15-cb570555170c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1317 microversion: 2.1 time: 0.263127 Nov 03 02:04:12.362359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 205/408] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:12 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:12.512034 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05ef107d-0303-4549-8e72-ec87c082aab7", "device": "/dev/sdb"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:12.515171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:12.533156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:12.539695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:12.540723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:12.548560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.241128 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a744c57c-51c4-412b-b5b5-4e1308aa8099 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "POST /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.734407 Nov 03 02:04:14.247120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 206/409] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:04:12 2021] POST /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586/os-volume_attachments => generated 194 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:14.252903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:14.253588 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:14.272667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.274457 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.275486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.280887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.513142 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:14.527230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:14.531633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:14.540648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e2876172-8bc3-4ebd-81e1-1b780249c4f3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.284611 Nov 03 02:04:14.541393 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 207/410] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:14 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:14.547512 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:14.547512 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:14.562157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.567606 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.568262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.568778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.625689 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.626163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.626600 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lazy-loading 'fault' on Instance uuid 51b4183b-6728-4119-b616-29bb8384c8d4 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:04:14.692931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03863f618f3c4649a8b478f027a14bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea66f47ad6c46779bbd1f09bfd5c5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:14.706169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-339b1573-276c-454f-b7ab-163993f0e313 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 200 len: 1302 microversion: 2.1 time: 0.163537 Nov 03 02:04:14.718470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 208/411] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:14 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:14.722031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:14.722715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:14.729675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.730413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.731396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.731832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:14.971931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:14.979268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1800c468-9e42-46ee-b944-6cf92d99a98e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1507 microversion: 2.1 time: 0.260859 Nov 03 02:04:14.979931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 209/412] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:14 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:14.985155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-548be7e9-db59-4a1e-9574-03d7a367fcf9 req-0d3ad74e-e510-4f9e-b35f-c5c4b583721e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b4183b-6728-4119-b616-29bb8384c8d4", "name": "network-vif-deleted", "tag": "c401d594-da88-49b7-9fee-e3f764425f67"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:14.987049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:14.987049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:04:14.998244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-548be7e9-db59-4a1e-9574-03d7a367fcf9 req-0d3ad74e-e510-4f9e-b35f-c5c4b583721e service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:14.998785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-548be7e9-db59-4a1e-9574-03d7a367fcf9 req-0d3ad74e-e510-4f9e-b35f-c5c4b583721e service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:15.012523 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-548be7e9-db59-4a1e-9574-03d7a367fcf9 req-0d3ad74e-e510-4f9e-b35f-c5c4b583721e service nova] Creating event network-vif-deleted:c401d594-da88-49b7-9fee-e3f764425f67 for instance 51b4183b-6728-4119-b616-29bb8384c8d4 on hv-cinder-81561 Nov 03 02:04:15.023143 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-548be7e9-db59-4a1e-9574-03d7a367fcf9 req-0d3ad74e-e510-4f9e-b35f-c5c4b583721e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041873 Nov 03 02:04:15.024180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 210/413] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:15.111093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:15.111093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:15.111093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:15.111093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:15.112111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:15.112111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:15.112111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lazy-loading 'flavor' on Instance uuid fe6fe0cb-1e19-4f19-84b4-15e0d56010fe {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:04:15.806916 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-73c169cd-6ece-4706-a4b4-e61d656ec4cf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action" status: 200 len: 32 microversion: 2.1 time: 0.781146 Nov 03 02:04:15.807673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 211/414] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:04:15 2021] POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action => generated 32 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:04:15.817433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bec34e8c-3051-47f4-885b-72a823fc777c"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:15.818797 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:15.849144 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:15.853767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:15.854782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:15.855216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:15.987136 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] HTTP exception thrown: Invalid volume: volume bec34e8c-3051-47f4-885b-72a823fc777c is already attached to instances: df7ffd60-ded0-4044-8e50-f1acf30e9dfd Nov 03 02:04:15.988065 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Returning 400 to user: Invalid volume: volume bec34e8c-3051-47f4-885b-72a823fc777c is already attached to instances: df7ffd60-ded0-4044-8e50-f1acf30e9dfd {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:04:15.989914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0779223e-d0a8-4ebd-bb7f-bdeca4e5f043 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.180939 Nov 03 02:04:15.995166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 212/415] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:04:15 2021] POST /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea/os-volume_attachments => generated 174 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:04:16.002838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:16.003941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:16.010745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:16.011546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:16.012620 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:16.013330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:16.657932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:16.666503 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:16.668265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:16.669466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f2a3470f-7908-4964-8fc9-a7a2bc93c9cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.672770 Nov 03 02:04:16.683386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 213/416] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:15 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:16.690580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:16.691347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] [instance: 51b4183b-6728-4119-b616-29bb8384c8d4] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:16.698361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:16.698868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:16.699778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:16.700316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:16.714601 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] HTTP exception thrown: Instance 51b4183b-6728-4119-b616-29bb8384c8d4 could not be found. Nov 03 02:04:16.715418 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] Returning 404 to user: Instance 51b4183b-6728-4119-b616-29bb8384c8d4 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:04:16.716351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9e6f407d-71df-4bc9-9023-77ac5cf52dd8 tempest-VolumesActionsTest-628163934 tempest-VolumesActionsTest-628163934-project] 10.222.0.30 "GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4" status: 404 len: 111 microversion: 2.1 time: 0.031906 Nov 03 02:04:16.720311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 214/417] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:16 2021] GET /compute/v2.1/servers/51b4183b-6728-4119-b616-29bb8384c8d4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:04:16.724793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:16.725627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:16.732176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:16.733251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:16.734156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:16.734655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:17.003609 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:17.024706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a806faa9-55f9-464a-8203-5248e17709fe tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.303198 Nov 03 02:04:17.025566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 215/418] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:16 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:17.032022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:17.032718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:17.050211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:17.055842 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:17.055842 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:17.055842 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:17.176024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lazy-loading 'services' on Instance uuid df7ffd60-ded0-4044-8e50-f1acf30e9dfd {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:04:17.865063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-317af3e5-c321-4058-a953-46ee82cde1b9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments/bec34e8c-3051-47f4-885b-72a823fc777c" status: 202 len: 0 microversion: 2.1 time: 0.838088 Nov 03 02:04:17.866382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 216/419] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:04:17 2021] DELETE /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments/bec34e8c-3051-47f4-885b-72a823fc777c => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:04:17.872287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:17.873268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:17.879607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:17.880239 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:17.881183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:17.881763 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.020496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:18.028438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:18.031350 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:18.032084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-84a3e243-4993-4a29-b461-f69273c11c2e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1740 microversion: 2.20 time: 0.164160 Nov 03 02:04:18.032315 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 217/420] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:17 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:18.041480 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:18.042567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:18.048596 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:18.049099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.056529 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:18.056529 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.081345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d8d4a4a6-e818-4fc5-b6ee-c73d6c534459 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047684 Nov 03 02:04:18.082038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 218/421] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:18 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:18.086374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:18.096910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:18.096910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:18.096910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.096910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:18.097320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.279100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:18.289574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-73b7beee-b9e9-41d6-aa3d-d62cfa8664a3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.206483 Nov 03 02:04:18.290176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 219/422] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:18 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:18.322816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] validate_networks() for None {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:04:18.702480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:04:18.703532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:04:18.704644 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:04:18.705370 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:04:18.706027 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:04:18.717602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:18.718052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.718910 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:18.719341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:18.738627 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Getting quotas for project b437a261d1c541edb0a4b366f3034ba3. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:04:18.742947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Getting quotas for user f04ec794b22e4b19aaa6fcad1856236a and project b437a261d1c541edb0a4b366f3034ba3. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:04:18.757607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:04:18.760367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:04:18.876124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-49aca4f3-661a-44e3-b57a-1c01ccdd2b43 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.140842 Nov 03 02:04:18.882702 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 204/423] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:04:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 8148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:04:18.888412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-91be5315-6f8e-411c-8f6c-4fab65840417 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:18.894568 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-91be5315-6f8e-411c-8f6c-4fab65840417 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:19.006351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-91be5315-6f8e-411c-8f6c-4fab65840417 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:19.013034 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-91be5315-6f8e-411c-8f6c-4fab65840417 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1214 microversion: 2.1 time: 0.127892 Nov 03 02:04:19.023667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 220/424] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:18 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:19.050163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:19.050882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:19.061449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:19.062575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:19.064543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:19.065762 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:19.094123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:19.095348 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:19.103368 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:19.104109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:19.105001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:19.105547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:19.150932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-60c126ae-ada6-4609-9f33-86e440b66b18 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061404 Nov 03 02:04:19.152013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 221/425] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:19 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:19.307256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:19.309221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:19.309983 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:19.315991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:19.317487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:19.320570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:19.322099 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4c9bcd4b-bc85-48ca-b18e-e8982f0ee502 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1722 microversion: 2.20 time: 0.273169 Nov 03 02:04:19.322836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:19.324027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:19.326905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:19.331129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 205/426] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:19 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:19.488346 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:19.496854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6b11f66c-7a82-47a8-91ef-a4580675b271 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.193166 Nov 03 02:04:19.507438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 222/427] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:19 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:20.029911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8db2e3d1-a28d-4c19-b72e-e06b8e3ce002 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:20.030640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8db2e3d1-a28d-4c19-b72e-e06b8e3ce002 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:20.096240 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8db2e3d1-a28d-4c19-b72e-e06b8e3ce002 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:20.103799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8db2e3d1-a28d-4c19-b72e-e06b8e3ce002 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1214 microversion: 2.1 time: 0.077279 Nov 03 02:04:20.104828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 206/428] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:20 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:20.162508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:20.164014 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:20.171271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:20.171636 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:20.172400 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:20.175182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:20.209672 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-58bb447b-9ad7-447e-86a8-e5eb9ffb45e8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050727 Nov 03 02:04:20.210814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 223/429] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:20 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:20.345786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:20.346532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:20.353004 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:20.353722 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:20.354657 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:20.355148 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:20.502442 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:20.511783 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:20.513352 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:20.515992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a1f154b7-0e5d-4fb6-acfd-35c5fee97267 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1722 microversion: 2.20 time: 0.178599 Nov 03 02:04:20.517554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 207/430] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:20 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:20.519312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:20.519927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:20.525948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:20.526414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:20.527524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:20.527976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:20.675786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:20.684235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b9e8d15c-2f22-4ff1-b83f-43ca8d063f03 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.173045 Nov 03 02:04:20.686335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 224/431] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:20 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:21.120854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:21.121502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:21.128212 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.128836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.129615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.130078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.268440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:21.268440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-413d3eb8-7185-46fe-8207-85710fa200ab tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1218 microversion: 2.1 time: 0.086488 Nov 03 02:04:21.268440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 208/432] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:21 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:21.270926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:21.270926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:21.270926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.270926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.273860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.273860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.273860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-95b440a5-3f67-4d8f-86ab-d17ac8239af1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Nov 03 02:04:21.273860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 225/433] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:21 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:21.538097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:21.538755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:21.545530 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.545977 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.546767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.547189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.686563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:21.694504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:21.695976 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:21.697148 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c307146e-1cf0-4585-9582-270b715b4528 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1722 microversion: 2.20 time: 0.162700 Nov 03 02:04:21.697791 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 209/434] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:21 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:21.702439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:21.703169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:21.708833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.709275 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.710040 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:21.710496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:21.839410 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:21.851859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-51408367-db64-4640-aacf-faea6d21bbf6 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.148934 Nov 03 02:04:21.851859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 226/435] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:21 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:22.279823 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:22.280789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:22.284992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:22.286406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:22.292862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.293341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.294076 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.294593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.296686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.300191 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.301103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.301697 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.338548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cf1a7fd1-7d2e-4a7a-b4f0-6bf9f6a556fc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062535 Nov 03 02:04:22.343131 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 210/436] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:22 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:22.401327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:22.408227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3c54b00c-792a-4d3c-919b-fd7344ce35a2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1218 microversion: 2.1 time: 0.128447 Nov 03 02:04:22.409156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 227/437] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:22 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:22.714809 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:22.715413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:22.725376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.725826 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.726673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.727105 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.864685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:22.865414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:22.868391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:22.871452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.871902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.872714 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:22.873178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:22.877192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:22.879461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:22.880320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-777e8670-77e1-45d0-a9a2-5f7a4f2a13da tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1722 microversion: 2.20 time: 0.169016 Nov 03 02:04:22.880907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 211/438] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:22 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:23.021623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:23.029996 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0cfbd468-84f0-40fd-a670-23d5c40dba50 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.168524 Nov 03 02:04:23.030597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 228/439] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:22 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:23.041855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a0ae7abf-f4c7-4c4f-a078-1ad7dfd29463 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Action: 'create', calling method: .version_select at 0x7f30c46d7790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-429003493"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:23.071410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-a0ae7abf-f4c7-4c4f-a078-1ad7dfd29463 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Getting quotas for project f13a412251cf4add8e72d0811966ade4. Resources: {'key_pairs'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:04:23.075111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-a0ae7abf-f4c7-4c4f-a078-1ad7dfd29463 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Getting quotas for user 6d9ee363c1764e37a737c05de0c3d67e and project f13a412251cf4add8e72d0811966ade4. Resources: {'key_pairs'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:04:23.351121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:23.352024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:23.353128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-a0ae7abf-f4c7-4c4f-a078-1ad7dfd29463 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Getting quotas for project f13a412251cf4add8e72d0811966ade4. Resources: {'key_pairs'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:04:23.356869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-a0ae7abf-f4c7-4c4f-a078-1ad7dfd29463 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Getting quotas for user 6d9ee363c1764e37a737c05de0c3d67e and project f13a412251cf4add8e72d0811966ade4. Resources: {'key_pairs'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:04:23.358486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:23.358928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:23.359728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:23.360151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:23.369541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a0ae7abf-f4c7-4c4f-a078-1ad7dfd29463 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.331220 Nov 03 02:04:23.370358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 212/440] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Nov 3 02:04:23 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:23.392106 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0b70c5f6-5ee7-454d-8314-428db2ac273f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045371 Nov 03 02:04:23.395715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 229/441] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:23 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:23.418219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-328614448", "imageRef": "1b4af9a4-1e2d-43bb-83e0-c7d75e623062", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-429003493", "networks": [{"uuid": "baa53bac-7dd3-4c8a-9217-9ded84eb710f"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:23.425382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:23.426635 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:23.432288 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:23.432837 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:23.433785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:23.434319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:23.474194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] validate_networks() for [('baa53bac-7dd3-4c8a-9217-9ded84eb710f', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:04:23.504558 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:23.506509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-aad10629-5ed6-415b-8019-18c1d0af8f0d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1266 microversion: 2.1 time: 0.085564 Nov 03 02:04:23.507076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 230/442] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:23 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:23.901564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:23.902494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:23.917851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:23.918729 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:23.920545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:23.921323 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.350349 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:24.363187 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:24.368154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:24.373853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0b7ab7d1-9e43-473a-b810-b33246b18e28 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1722 microversion: 2.20 time: 0.478069 Nov 03 02:04:24.382227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 231/443] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:23 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:24.387820 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:24.388603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:24.398652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.399390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.400809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.401396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.427932 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:04:24.429894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:04:24.430594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:04:24.431214 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:04:24.431794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:04:24.454979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.456451 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.458787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.459591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.484695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Getting quotas for project f13a412251cf4add8e72d0811966ade4. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:04:24.489576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Getting quotas for user 6d9ee363c1764e37a737c05de0c3d67e and project f13a412251cf4add8e72d0811966ade4. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:04:24.506363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:04:24.509011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4af9a4-1e2d-43bb-83e0-c7d75e623062',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:04:24.655593 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:24.668271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2ac309d4-051b-4c2c-91a3-3f016262e3fd tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.290162 Nov 03 02:04:24.668971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 232/444] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:24 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:24.674339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-c89f5a00-9315-4e88-b408-1cf16b55f4f0 req-f31ad1ad-2ea9-42db-bd0a-5255fba76189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "name": "network-vif-unplugged", "status": "completed", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:24.676799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:24.676799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:04:24.698782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-c89f5a00-9315-4e88-b408-1cf16b55f4f0 req-f31ad1ad-2ea9-42db-bd0a-5255fba76189 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.699405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-c89f5a00-9315-4e88-b408-1cf16b55f4f0 req-f31ad1ad-2ea9-42db-bd0a-5255fba76189 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.721491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-886e3d6c-084b-4ccb-8103-78ae0027ad6f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306045 Nov 03 02:04:24.730862 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-c89f5a00-9315-4e88-b408-1cf16b55f4f0 req-f31ad1ad-2ea9-42db-bd0a-5255fba76189 service nova] Creating event network-vif-unplugged:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:04:24.735718 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 213/445] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:04:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:04:24.737939 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-c89f5a00-9315-4e88-b408-1cf16b55f4f0 req-f31ad1ad-2ea9-42db-bd0a-5255fba76189 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067202 Nov 03 02:04:24.739072 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 233/446] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:24.745260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:24.746043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:24.752651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.753148 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:24.753806 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.754835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.755553 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.755745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:24.767157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.767995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.769109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:24.769743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:24.811165 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7c5ff6ab-3bae-424b-9078-8b4b15109578 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067744 Nov 03 02:04:24.812018 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 214/447] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:24 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:24.823540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-53ebfd86-41fc-477d-9abb-19958dac59d9 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:24.824724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-53ebfd86-41fc-477d-9abb-19958dac59d9 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:24.847566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:24.859629 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ac878d44-577e-41b8-b1ad-2bb313c7282d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1272 microversion: 2.1 time: 0.119124 Nov 03 02:04:24.869678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 234/448] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:24 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:24.931627 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-53ebfd86-41fc-477d-9abb-19958dac59d9 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:24.944023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-53ebfd86-41fc-477d-9abb-19958dac59d9 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1257 microversion: 2.1 time: 0.125679 Nov 03 02:04:24.948594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 215/449] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:24 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1257 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:25.396895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:25.398140 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:25.408364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.408825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.409622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.410050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.687668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:25.689506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:25.700189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.702790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.704020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.704774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.756120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:25.778330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:25.778330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:25.778330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ce84f453-56c7-47a4-a0a7-4aa5e1f28d41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1722 microversion: 2.20 time: 0.379976 Nov 03 02:04:25.778666 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 235/450] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:25 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:25.825576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:25.827284 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:25.835963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.842368 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.846180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.846180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.903252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1dfbfd37-3a5d-4195-bcbe-d83b422aba93 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083210 Nov 03 02:04:25.904531 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 236/451] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:04:25 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 02:04:25.910262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:25.911357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:25.918957 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.922836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.922836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:25.922836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:25.982960 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:26.007579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ad8de9a7-8588-4870-a3b1-476ee1d586f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.320260 Nov 03 02:04:26.016758 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 216/452] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:25 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:26.028172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3b6b9cbf-2e8c-411f-9437-66d0d8804905 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:26.028786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3b6b9cbf-2e8c-411f-9437-66d0d8804905 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:26.157325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3b6b9cbf-2e8c-411f-9437-66d0d8804905 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:26.167394 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3b6b9cbf-2e8c-411f-9437-66d0d8804905 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1257 microversion: 2.1 time: 0.156133 Nov 03 02:04:26.168709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 217/453] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:26 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:26.200468 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1291144013", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "b9f1ba25-c9df-4fb7-a2b7-25e385903abb"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:26.275533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] validate_networks() for [('b9f1ba25-c9df-4fb7-a2b7-25e385903abb', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:04:26.409125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:26.416807 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5b3596fc-94ea-4cd0-8fe5-9ca44c5cdace tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.511019 Nov 03 02:04:26.417391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 237/454] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:25 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:26.792154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:26.793456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:26.803626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:26.804572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:26.805545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:26.806275 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.073639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:04:27.074268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:04:27.074837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:04:27.075358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:04:27.077399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:04:27.092426 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.101515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.102556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.103072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.145276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:04:27.153177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for user c920199e7537410989d8118aecfeb6d9 and project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:04:27.179582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:04:27.181866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:04:27.238822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.246676 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.248228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.249382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2ebb6baf-c62f-40ea-a230-8600a289f8cb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1665 microversion: 2.20 time: 0.461953 Nov 03 02:04:27.250316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 238/455] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:26 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1665 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:27.255083 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:27.256181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:27.270717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.271582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.273463 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.274186 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.385148 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-005aa0ed-5dcf-4e3a-9e12-5ca013aaa9b1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205161 Nov 03 02:04:27.404318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 218/456] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:04:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:04:27.404318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:27.404318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:27.404318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.404318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.404881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.404881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.475558 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.491635 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-46181ca2-6a02-49a3-85f9-b9a2fb56577e tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.238352 Nov 03 02:04:27.493111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.494749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 239/457] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:27 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:27.501149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68bd3853-4820-4b9f-916f-b1deaa5f7ba5"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:27.502807 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:27.516805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-aee3e0df-e860-4d37-afe2-a1d80a2aaf6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1253 microversion: 2.1 time: 0.124611 Nov 03 02:04:27.521438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.522158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.523151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.523649 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 219/458] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:27 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1253 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:27.524037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.533661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-15964078-39a1-4e64-9f97-17fda7ec3680 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:27.535825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-15964078-39a1-4e64-9f97-17fda7ec3680 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:27.667055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-15964078-39a1-4e64-9f97-17fda7ec3680 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.682536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-15964078-39a1-4e64-9f97-17fda7ec3680 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1218 microversion: 2.1 time: 0.149554 Nov 03 02:04:27.682536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 220/459] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:27 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:27.682536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:27.682536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:27.690161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.690733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.691635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.692145 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.890610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:27.899628 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e5b177fc-04d2-4f88-bcbb-b1224bf110c2 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.223256 Nov 03 02:04:27.900233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 221/460] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:27 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:27.905602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-0f283184-39c3-416a-a1bf-39417c9f73e4 req-38333830-ae4d-4b96-8594-e61ee4e5068d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9dcb982-e537-49db-aa7e-2a5060b12d2a", "tag": "c6cc6d29-8315-4b6b-bd7c-54586185d3f8"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:27.907312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:27.907312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:04:27.915009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-0f283184-39c3-416a-a1bf-39417c9f73e4 req-38333830-ae4d-4b96-8594-e61ee4e5068d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:27.915454 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-0f283184-39c3-416a-a1bf-39417c9f73e4 req-38333830-ae4d-4b96-8594-e61ee4e5068d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:27.929203 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-0f283184-39c3-416a-a1bf-39417c9f73e4 req-38333830-ae4d-4b96-8594-e61ee4e5068d service nova] Creating event network-changed:c6cc6d29-8315-4b6b-bd7c-54586185d3f8 for instance d9dcb982-e537-49db-aa7e-2a5060b12d2a on hv-cinder-81561 Nov 03 02:04:27.934854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-0f283184-39c3-416a-a1bf-39417c9f73e4 req-38333830-ae4d-4b96-8594-e61ee4e5068d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033323 Nov 03 02:04:27.935902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 222/461] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:28.513811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:28.513811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:28.525615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.526706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.527588 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.528068 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.709765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:28.720583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fbfbf942-5b11-4935-ae00-77f24bf60a1a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.212745 Nov 03 02:04:28.721175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 223/462] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:28 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:28.726639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:28.727564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:28.734410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.734865 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.735645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.736226 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.805956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:28.814617 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ed0d7a6c-ec5a-4b14-8a7e-6f4f0cc561a6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1253 microversion: 2.1 time: 0.091877 Nov 03 02:04:28.823135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 224/463] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:28 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1253 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:28.830066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:28.830914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:28.840708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.842841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.843237 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.843913 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.931935 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:28.942425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-161bb612-5421-4a7d-80dd-e065c47dde6f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1222 microversion: 2.1 time: 0.117804 Nov 03 02:04:28.951820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 225/464] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:28 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:28.962597 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:28.963306 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:28.975201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.979353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:28.979353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:28.979353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.139646 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:29.152076 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-798177d9-9a3c-4500-b486-6d65783e01ff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.208000 Nov 03 02:04:29.152949 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 226/465] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:28 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:29.164579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3f274c60-5894-411f-8019-5f91e3a997d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.668431 Nov 03 02:04:29.170419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 240/466] 10.222.0.30 () {62 vars in 1363 bytes} [Wed Nov 3 02:04:27 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments => generated 188 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:04:29.285433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:29.286074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:29.292390 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.293026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.293794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.294280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.556061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a85dcf76-2b69-4d97-a835-e768b3bed943 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action" status: 202 len: 0 microversion: 2.20 time: 0.274716 Nov 03 02:04:29.562347 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 227/467] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:04:29 2021] POST /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:04:29.571149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:29.571785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:29.588001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.588001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.588001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.588001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.738096 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:29.738737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:29.750104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.752314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.753117 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.753569 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.761190 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:29.778344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:29.778344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:29.778344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-90dda1e1-2d39-4ba6-8693-2d227236b5c1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1751 microversion: 2.20 time: 0.214560 Nov 03 02:04:29.778699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 241/468] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:29 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:29.835287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:29.835287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:29.843989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.844736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.845748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.846415 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.952552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:29.962857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1bd7345f-9a9c-4a08-a169-e041dc0c5041 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1253 microversion: 2.1 time: 0.134313 Nov 03 02:04:29.976742 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 242/469] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:29 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1253 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:29.985301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:29.986090 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:29.997224 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.997889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:29.998898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:29.999449 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:30.103802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:30.113657 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0426eb32-097b-4920-9a3f-3e2c0d80a909 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1222 microversion: 2.1 time: 0.135553 Nov 03 02:04:30.114988 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 243/470] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:29 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:30.168524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:30.169205 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:30.188564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:30.189094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:30.190183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:30.190610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:30.220201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:30.229505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b217eb8d-ba05-4237-b356-633341688189 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.496238 Nov 03 02:04:30.230147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 228/471] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:29 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:30.809616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:30.816916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:30.838398 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:30.841692 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:30.841692 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:30.841692 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.190213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.201052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fa815c0e-9664-47c2-98b6-b21c7078baa7 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 1.034562 Nov 03 02:04:31.206482 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 244/472] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:30 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:31.206482 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:31.207216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:31.215692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:31.216145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.217614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:31.218042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.359506 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.367434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7fdc1ed6-32fe-407d-9ba8-2ccbf9ebfd65 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1317 microversion: 2.1 time: 0.164530 Nov 03 02:04:31.368207 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 245/473] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:31 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:31.382069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:31.382858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:31.389604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:31.390073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.390901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:31.391333 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.462808 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.478560 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.480185 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.481688 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cee1b4f9-e707-4973-89c5-eae93f93e739 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1751 microversion: 2.20 time: 0.685079 Nov 03 02:04:31.482850 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 229/474] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:30 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1751 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:31.498694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:31.499314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:31.508704 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:31.509321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.511032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:31.511724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:31.550244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.564685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1ec2c927-3670-4d2d-be4e-be22eb27927a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1270 microversion: 2.1 time: 0.184078 Nov 03 02:04:31.564685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 246/475] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:31 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:31.696737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:31.705483 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c6cd77c5-8999-4e54-b7ba-6e3acdb58fdb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.221039 Nov 03 02:04:31.706117 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 230/476] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:31 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:32.225313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:32.225911 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:32.232705 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.233152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.233918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.234378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.383161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.384249 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:32.384879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:32.392552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.393004 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.393132 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cc6f145d-8cfc-43da-ac8b-cbe7647d7aa0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.171330 Nov 03 02:04:32.393800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.394265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.397741 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 247/477] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:32 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:32.462926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.471760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-85f68dbd-e203-4506-bd1c-4e8c96d87529 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1315 microversion: 2.1 time: 0.091051 Nov 03 02:04:32.472906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 231/478] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:32 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1315 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:32.503543 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:32.504483 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:32.510999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.511450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.512233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.512666 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.581163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:32.582088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:32.588118 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.589067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.590128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.590657 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.668412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.679407 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-df6a1140-228e-43cb-97f4-68f0a749d16a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1270 microversion: 2.1 time: 0.102521 Nov 03 02:04:32.690701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 232/479] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:32 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:32.694163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.704334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.705983 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.707280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0226a522-f398-4ab8-acf9-d3aebac2409e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1751 microversion: 2.20 time: 0.207438 Nov 03 02:04:32.708131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 248/480] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:32 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:32.721562 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:32.722192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:32.730158 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.730735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.731527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:32.731987 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:32.875446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:32.883485 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b56b4167-bd2c-4599-ba52-e0c4d80312a5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.165601 Nov 03 02:04:32.884310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 233/481] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:32 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:33.410391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:33.411608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:33.418097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.418781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.419774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.420385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.491148 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:33.492193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:33.499331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.500107 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.501179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.501820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.596434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:33.603983 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:33.611205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2189dac6-2b94-4f10-bc53-cbb07bb16eb3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1315 microversion: 2.1 time: 0.125127 Nov 03 02:04:33.612130 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 234/482] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:33 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1315 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:33.623853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-105b4470-e656-46a0-a40b-ee397663c082 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.217104 Nov 03 02:04:33.634860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 249/483] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:33 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:33.697683 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:33.698379 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:33.704947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.705565 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.706594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.707119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.727227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:33.728158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:33.735624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.736120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.736951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.737463 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.782013 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:33.790000 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b56542df-89b9-4552-a4e2-1f5fe9b4dafe tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1270 microversion: 2.1 time: 0.096256 Nov 03 02:04:33.791205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 235/484] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:33 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:33.900575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:33.902478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:33.903231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:33.909860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.910752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.911541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:33.911670 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:33.912143 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:33.913076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:33.914271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-71656561-d165-4c64-aaa7-306a9cf8c736 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1751 microversion: 2.20 time: 0.190767 Nov 03 02:04:33.915146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 250/485] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:33 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:34.064543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:34.072543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1e877d9d-ff2f-4b73-878a-8e2000d2d572 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.173636 Nov 03 02:04:34.073943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 236/486] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:33 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:34.629146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:34.629751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:34.643889 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:34.645137 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:34.646555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:34.650474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:34.651462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:34.652081 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:34.656088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:34.668772 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:34.670999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:34.672322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:34.869998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:34.897941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6a9134b5-ba2d-4d1d-a418-cb5b4287ae3a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1315 microversion: 2.1 time: 0.254603 Nov 03 02:04:34.901719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 251/487] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:34 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:34.915771 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:34.918657 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:34.942445 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:34.943469 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:34.944426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:34.947667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:35.164351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:35.174097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0f28940b-9cc2-4334-86f1-b8eeebb8e46d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1278 microversion: 2.1 time: 0.270863 Nov 03 02:04:35.183699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 252/488] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:34 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:35.186685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:35.188310 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:35.196105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:35.196795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:35.197892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:35.198557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:35.448998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:35.448998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-87b91cec-7da1-4d6a-b78a-0eb5cd2e6a7c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.753752 Nov 03 02:04:35.448998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 237/489] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:34 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:35.448998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:35.449510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:35.449510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:35.449510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:35.449510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:35.450008 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:35.721421 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:35.730115 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:35.731715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:35.733517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4d77c2e9-5846-441d-ad6c-aaf96c07c722 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.553864 Nov 03 02:04:35.734070 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 253/490] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:35 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:35.915296 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:35.919133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:35.921045 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:35.926905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-48a555fb-838a-4365-bf99-1adb69c6b22f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.516214 Nov 03 02:04:35.937028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 238/491] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:35 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:35.940647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:35.942024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:35.943451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:35.946513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:36.192733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:36.193476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:36.208085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:36.208537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:36.209696 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:36.210415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:36.680803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:36.690196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-41e1a9ee-df73-4ab6-a36f-2e4b64537c9d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.777000 Nov 03 02:04:36.696777 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:36.725597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 254/492] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:35 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:36.726175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d705cd71-798d-4535-912f-77ce9b8a830f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.529422 Nov 03 02:04:36.726175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 239/493] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:36 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:36.746518 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:36.747139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:36.757300 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:36.762668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:36.763312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:36.769355 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:36.769808 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:36.770637 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:36.771073 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:36.775004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:36.776126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:36.776585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.074719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:37.079452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:37.095054 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a8115dc6-448e-40e5-9fbd-96857045990b tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.375065 Nov 03 02:04:37.096604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:37.106575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 255/494] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:36 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:37.110665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:37.114015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:37.115339 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8abfae0d-1721-4dd5-b107-68e5b5b1b92a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.356261 Nov 03 02:04:37.116006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 240/495] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:36 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:37.117031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:37.124273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:37.124832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.125870 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:37.127010 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.269980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:37.280441 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2b731c44-b67e-4398-a007-46a491bf9225 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.171258 Nov 03 02:04:37.281360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 256/496] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:37 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:37.733216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:37.733962 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:37.736723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:37.737557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:37.742169 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:37.742665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.743642 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:37.744275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.745501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:37.746127 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.747109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:37.748149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:37.946312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:37.957238 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9ddd57c1-ff44-4b7a-945c-d12578ed5225 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.227662 Nov 03 02:04:37.962241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 241/497] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:37 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:37.998479 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:38.009300 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-539f55e7-3d34-4a04-9c89-41cf05954e90 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.276356 Nov 03 02:04:38.009931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 257/498] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:37 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:38.112534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:38.113749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:38.120697 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.121156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.121938 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.122893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.137533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:38.139497 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:38.145494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.145941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.146881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.147482 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.356076 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:38.360426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:38.373539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-62fde6d9-93a0-4b4d-bbfa-d4dc9ea197f6 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.263933 Nov 03 02:04:38.374239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 242/499] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:38 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:38.379571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:38.380880 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:38.388532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.389488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.390776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.391807 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.391988 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:38.394816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:38.397730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-dc65968b-9ce5-42b3-926d-764d9d052f84 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.264386 Nov 03 02:04:38.426313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 258/500] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:38 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:38.611819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:38.619801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4f1ab9a8-0499-4efd-aa6f-4a22703b1191 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.244326 Nov 03 02:04:38.620373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 243/501] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:38 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:38.974496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:38.975875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:38.984734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.985363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:38.986446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:38.987173 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.036441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:39.037055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:39.047845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.047845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.047845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.048350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.211714 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:39.219528 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-13ae2db5-d160-4ea3-9cc3-b192ef66ae9b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.248978 Nov 03 02:04:39.220106 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 259/502] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:38 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:39.239017 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:39.246236 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-00c48c83-47ce-4d72-8df1-26b598db688d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.223357 Nov 03 02:04:39.246804 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 244/503] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:39 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:39.391960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:39.392990 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:39.403427 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.405635 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.407355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.408064 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.434318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:39.434972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:39.456645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.457364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.458754 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.459404 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.691626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:39.708323 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cce04722-7ff7-4570-8069-ee6d4778186e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.320867 Nov 03 02:04:39.708916 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 260/504] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:39 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:39.719015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:39.722577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:39.733104 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.736053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.736053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:39.738955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:39.874748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:39.886873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:39.896696 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:39.898735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-54da112b-f430-46ba-aa18-99c056653a3b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.467353 Nov 03 02:04:39.899474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 245/505] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:39 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:39.995361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:40.006773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b2fef779-e03c-4984-949e-ff6eccd151a1 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.295639 Nov 03 02:04:40.018598 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 261/506] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:39 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:40.237162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:40.238205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:40.245174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.246833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.247937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.248659 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.262642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:40.263287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:40.275822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.276276 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.277431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.277874 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.784616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:40.794508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c3536c58-1633-4141-b352-97caf4373867 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.561947 Nov 03 02:04:40.805265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 246/507] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:40 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:40.810368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:40.811600 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:40.820106 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.820106 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.820818 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.821409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.825394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:40.834329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5aec7f4a-baa3-4b2b-9794-1cbf19e6b119 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.575147 Nov 03 02:04:40.846839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 262/508] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:40 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:40.919536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:40.921239 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:40.938178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.942431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:40.948321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:40.948978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:41.202847 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:41.254409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-babdf811-8d7c-43b7-a57b-17f9dec8ee25 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.447568 Nov 03 02:04:41.288473 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 247/509] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:40 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:41.329743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:41.336020 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:41.339106 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:41.356211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:41.360161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:41.362676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:41.363674 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:41.364656 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:41.366154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c3e95546-0a28-4602-859c-d80ece604379 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.452891 Nov 03 02:04:41.366884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:41.375046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 263/510] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:40 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:41.665091 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:41.674391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8b3dfb19-9bea-4306-8999-cb82c29debce tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.383082 Nov 03 02:04:41.675292 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 248/511] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:41 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:41.811676 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:41.813059 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:41.830028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:41.831414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:41.832976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:41.833852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:41.867232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:41.868870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:41.878325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:41.884573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:41.885992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:41.886555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.167112 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.177506 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e6b0b023-42a1-4533-8b65-e16c3565d04f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.369598 Nov 03 02:04:42.189105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 264/512] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:41 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:42.195578 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-dab043d3-56bb-44c3-b37e-ff7204af1d9a req-f5de7cf1-b6c3-4d78-93dc-1e645b0952b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9dcb982-e537-49db-aa7e-2a5060b12d2a", "name": "network-vif-plugged", "status": "completed", "tag": "c6cc6d29-8315-4b6b-bd7c-54586185d3f8"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:42.198826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:42.198826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:04:42.209134 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-dab043d3-56bb-44c3-b37e-ff7204af1d9a req-f5de7cf1-b6c3-4d78-93dc-1e645b0952b1 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.210056 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-dab043d3-56bb-44c3-b37e-ff7204af1d9a req-f5de7cf1-b6c3-4d78-93dc-1e645b0952b1 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.223683 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.227437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-dab043d3-56bb-44c3-b37e-ff7204af1d9a req-f5de7cf1-b6c3-4d78-93dc-1e645b0952b1 service nova] Creating event network-vif-plugged:c6cc6d29-8315-4b6b-bd7c-54586185d3f8 for instance d9dcb982-e537-49db-aa7e-2a5060b12d2a on hv-cinder-81561 Nov 03 02:04:42.234099 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8fa91062-f875-4f39-82b3-d9482d513bdc tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.371448 Nov 03 02:04:42.234976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-dab043d3-56bb-44c3-b37e-ff7204af1d9a req-f5de7cf1-b6c3-4d78-93dc-1e645b0952b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043622 Nov 03 02:04:42.235350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 249/513] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:41 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:42.236054 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 265/514] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:42.293279 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:42.294173 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:42.302024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.302736 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.303513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.303946 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.394334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:42.395804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:42.427111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.428033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.429739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.430515 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.648652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.656974 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4a442a77-2c11-4532-bc9b-28727b12e552 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.368389 Nov 03 02:04:42.658762 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 250/515] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:42 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:42.693163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:42.693776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:42.705561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.706014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.706840 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:42.707272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:42.731433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.744644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.747278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.749314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-48a9e4bb-d569-4fdf-9804-bdca931b3417 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.359538 Nov 03 02:04:42.750468 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 266/516] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:42 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:42.909845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:42.917930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3f8eb4ae-73e8-4dcf-a7e5-e38a7113641d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.228295 Nov 03 02:04:42.918575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 251/517] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:42 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:43.194639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:43.195172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:43.201963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.202476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.203258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.203687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.249978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:43.250622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:43.256667 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.257129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.257944 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.258431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.416624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:43.424177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bd45aea8-6ff6-44e0-b221-1d941f4ed666 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.233212 Nov 03 02:04:43.424858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 267/518] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:43 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:43.457743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:43.465217 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f6453564-b7dc-4064-b113-0c1beca72061 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.218896 Nov 03 02:04:43.465800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 252/519] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:43 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:43.672554 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:43.673164 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:43.679093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.679541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.680317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.680809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.766902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:43.767513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:43.773282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.773727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.774525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.774957 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.813559 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:43.820981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a8aa806c-077a-4442-9765-a8564a0c6f06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.152014 Nov 03 02:04:43.832806 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 268/520] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:43 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:43.946343 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:43.946985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:43.953398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.953857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.954750 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:43.955179 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:43.990827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:44.000848 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:44.004436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:44.004436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a025ffea-48d8-4b67-8907-b1d1a34641de tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1753 microversion: 2.20 time: 0.241221 Nov 03 02:04:44.004436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 253/521] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:43 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:44.244192 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:44.265908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2030c9f3-8153-481b-9577-edb8e426bfdf tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.312285 Nov 03 02:04:44.265908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 269/522] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:43 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:44.441632 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:44.449320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:44.452211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:44.454893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:44.457012 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:44.459410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:44.484178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:44.485567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:44.492695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:44.493452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:44.494707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:44.495535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.126969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:45.144829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-50c00d9e-8827-4164-955f-ef90acb38a68 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.666006 Nov 03 02:04:45.150317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 270/523] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:44 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:45.168547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:45.169991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:45.178488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.183597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.183597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.183597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.230252 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:45.239730 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5335fa55-eb05-485f-8f4d-b31d37a52d90 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.802275 Nov 03 02:04:45.240396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 254/524] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:44 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:45.244911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:45.245582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:45.251417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.251942 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.252815 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.253310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.492730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:45.507928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-72b81c68-2ecc-4acc-bbd6-8ae3aa7a48b0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.344795 Nov 03 02:04:45.508651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 271/525] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:45 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:45.513303 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-9484cd21-f78d-4ca8-8861-348cb90a222a req-3e443597-59fe-4bbb-aebe-aa302666efbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b0b0ce-2322-4f89-9a79-3efd949ae8ce", "tag": "ff09ef64-e5d7-4f1b-a870-3f00abdc5961"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:45.515758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:45.515758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:04:45.526231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-9484cd21-f78d-4ca8-8861-348cb90a222a req-3e443597-59fe-4bbb-aebe-aa302666efbd service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.526674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-9484cd21-f78d-4ca8-8861-348cb90a222a req-3e443597-59fe-4bbb-aebe-aa302666efbd service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.556489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-9484cd21-f78d-4ca8-8861-348cb90a222a req-3e443597-59fe-4bbb-aebe-aa302666efbd service nova] Creating event network-changed:ff09ef64-e5d7-4f1b-a870-3f00abdc5961 for instance e8b0b0ce-2322-4f89-9a79-3efd949ae8ce on hv-cinder-81561 Nov 03 02:04:45.563885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-9484cd21-f78d-4ca8-8861-348cb90a222a req-3e443597-59fe-4bbb-aebe-aa302666efbd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053787 Nov 03 02:04:45.568390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 272/526] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:45.576075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:45.583067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:45.600095 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.601281 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.602933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.603746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.628415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:45.643407 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:45.645466 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:45.651349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-76fcbc8c-0313-4917-88b2-b0402995386c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.406661 Nov 03 02:04:45.651349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 255/527] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:45 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:45.661062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:45.662093 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:45.673482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.675966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.677477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:45.681622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:45.790967 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lazy-loading 'services' on Instance uuid a90dea4f-ac73-4fbb-b103-80101d052586 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:04:45.992824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.000858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1322fc8e-7eeb-47e8-99c5-9195bebb5a73 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.349866 Nov 03 02:04:46.001427 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 256/528] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:45 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:46.008767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-e90298f0-a9fa-495e-9b1a-5992cdc47194 req-6d8a8979-5530-418d-90d5-252849d59394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:46.010579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:46.010579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:04:46.017810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-e90298f0-a9fa-495e-9b1a-5992cdc47194 req-6d8a8979-5530-418d-90d5-252849d59394 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.018297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-e90298f0-a9fa-495e-9b1a-5992cdc47194 req-6d8a8979-5530-418d-90d5-252849d59394 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.029323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-e90298f0-a9fa-495e-9b1a-5992cdc47194 req-6d8a8979-5530-418d-90d5-252849d59394 service nova] Creating event network-changed:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:04:46.034615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-e90298f0-a9fa-495e-9b1a-5992cdc47194 req-6d8a8979-5530-418d-90d5-252849d59394 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Nov 03 02:04:46.035368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 257/529] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:46.144878 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2e5249e1-d73f-4abe-bfad-9ffb2d724e46 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586/os-volume_attachments/05ef107d-0303-4549-8e72-ec87c082aab7" status: 202 len: 0 microversion: 2.1 time: 0.574694 Nov 03 02:04:46.145397 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 273/530] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:04:45 2021] DELETE /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586/os-volume_attachments/05ef107d-0303-4549-8e72-ec87c082aab7 => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:04:46.168635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:46.169359 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:46.175584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.176042 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.176815 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.177249 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.257679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:46.258437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:46.265537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.265984 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.266785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.267210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.324753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.332857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d0fb7b57-4c78-4259-a665-6ecbd3c9f2ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.168216 Nov 03 02:04:46.333834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 258/531] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:46 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:46.432854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.441263 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a5fac73f-1092-4ba9-9de9-30e03e62f8da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.188183 Nov 03 02:04:46.445882 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 274/532] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:46 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:46.525780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:46.526422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:46.534741 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.535213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.535988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.536418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.703590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.710933 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-333a1fed-1d72-423b-a4a8-d28295b3edde tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.189861 Nov 03 02:04:46.711517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 259/533] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:46 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:46.735369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:46.736009 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:46.741954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.742506 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.743289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:46.743722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:46.885760 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.894786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.896307 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:46.897508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ec06dce5-1c79-46d1-a684-c9d5a14b26e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.166027 Nov 03 02:04:46.898072 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 275/534] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:46 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:47.036852 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:47.038293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:47.048126 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.048665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.049745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.050193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.251622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:47.266667 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-de742523-bb09-4507-b66d-8c5e218504aa tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.238185 Nov 03 02:04:47.267247 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 260/535] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:47 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:47.349747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:47.350450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:47.356721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.357251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.358044 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.358499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.466838 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:47.467443 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:47.473982 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.474476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.475257 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.475705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.511878 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:47.520080 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3b97cd77-9fcf-48f4-99d8-01d271a6a197 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.173734 Nov 03 02:04:47.520675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 276/536] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:47 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:47.620784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:47.629183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f4bfbf3e-2b6e-4735-802b-b2a849ecc923 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.165957 Nov 03 02:04:47.629762 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 261/537] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:47 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:47.727946 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:47.728477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:47.735005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.735454 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.736327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.736699 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.908459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:47.915595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:47.916870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:47.917310 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-da35c40b-f8c5-41c4-bea8-7c5a10941658 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.193273 Nov 03 02:04:47.918239 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 277/538] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:47 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:47.924769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.925263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:47.926267 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:47.926733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.069224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:48.088080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:48.107916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:48.107916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3728f55a-fb6a-46a4-a8f7-a26167e821d8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.178902 Nov 03 02:04:48.107916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 262/539] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:47 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:48.288124 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:48.288124 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:48.291522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.291960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.292728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.293149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.436556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:48.444590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7654dee3-c8ef-4891-a1b2-a8feb2ecb00f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.163983 Nov 03 02:04:48.445175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 278/540] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:48 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:48.536860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:48.537373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:48.545352 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.545887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.546787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.547291 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.645610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:48.647858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:48.652672 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.653120 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.654536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.654969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.689816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:48.698937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0590ba45-8896-4879-a2dd-1e1d9782d33c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.165300 Nov 03 02:04:48.703923 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 263/541] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:48 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:48.812168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:48.819927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0d7f5ac3-a489-4850-aa65-c56b0efadb3f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.178102 Nov 03 02:04:48.820497 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 279/542] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:48 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:48.953312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:48.954335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:48.963237 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.963748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:48.964971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:48.965712 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.110359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:49.112075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:49.119938 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.122618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.123701 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.124347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.173087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:49.181425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a6b0b05a-4a7f-4316-ad38-32d73330eb67 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.234734 Nov 03 02:04:49.191936 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 264/543] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:48 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:49.295875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:49.313722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:49.315995 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:49.317442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a80d7929-4aea-4afe-938a-6effe3698fdb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.212238 Nov 03 02:04:49.318695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 280/544] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:49 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:49.462441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:49.463028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:49.473152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.473598 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.474425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.474858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.631763 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:49.641090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bd3ce460-75b0-4d1d-b2f6-00d2c3eb3b6d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.182490 Nov 03 02:04:49.641585 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 265/545] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:49 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:49.716088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:49.716744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:49.723922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.724645 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.725722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.726582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.836943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:49.850103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:49.850103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.850103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.850103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:49.850853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:49.876806 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:49.885234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f546ae59-929f-4b50-bf09-237a62207f5d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.173305 Nov 03 02:04:49.885838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 281/546] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:49 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:50.011965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:50.022053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5340e4f8-c075-455d-8ea9-119e09704a0a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.188652 Nov 03 02:04:50.022937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 266/547] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:49 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:50.199053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:50.214486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:50.214486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.214486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.214486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.214851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.336879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:50.337489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:50.343854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.344161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.344943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.345380 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.346623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:50.356720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-81a4eddf-cefd-4481-8243-e2726c8320a3 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.159355 Nov 03 02:04:50.363990 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 282/548] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:50 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:50.500030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:50.508757 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:50.510310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:50.511518 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-abedd05f-62dd-408e-9bce-b3c86fc22c17 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.178915 Nov 03 02:04:50.512211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 267/549] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:50 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:50.657773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:50.658347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:50.664378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.664825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.665745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.666251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.815769 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:50.823506 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-998a9393-c251-4362-93c4-7ec1a6fbd6e3 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.169567 Nov 03 02:04:50.824073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 283/550] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:50 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:50.902548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:50.903187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:50.909682 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.910074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:50.910898 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:50.911337 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.039960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:51.040712 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:51.046555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.047001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.047784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.048443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.053169 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:51.061154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-457c192e-5df4-430f-a7ec-db5709c6182a tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.162437 Nov 03 02:04:51.061810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 268/551] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:50 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:51.203929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:51.212324 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-15670c8a-4b09-4093-b2c7-e095bb79d2e7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.176210 Nov 03 02:04:51.212893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 284/552] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:51 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:51.371083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:51.371688 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:51.378564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.379016 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.379785 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.380216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.513220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:51.523932 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f22739fa-3877-4b1b-921d-481c56ca4d06 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.155841 Nov 03 02:04:51.531296 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 269/553] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:51 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:51.537783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:51.538419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:51.548844 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.549299 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.550087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.550537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.687741 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:51.696531 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:51.698174 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:51.699412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-69217d03-ee48-4025-b100-fd65a7f88cb9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.165493 Nov 03 02:04:51.700250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 285/554] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:51 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:51.842843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:51.843447 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:51.850110 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.853092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:51.853092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:51.853092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.078185 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:52.078804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:52.084944 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.085394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.086232 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.086668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.108871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.118314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-deb71749-2b5f-4d95-a28a-5e49110d45e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.279501 Nov 03 02:04:52.118999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 270/555] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:51 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:52.229350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:52.229917 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:52.235897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.236423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.237270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.237716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.324035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.331907 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d948834a-c278-4a13-8f0b-ff53ec91f2c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.257391 Nov 03 02:04:52.332567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 286/556] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:52 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:52.411778 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.418964 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6e72271f-1bd6-4486-bf17-529adbf5d6da tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.193451 Nov 03 02:04:52.419519 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 271/557] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:52 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:04:52.539221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:52.539836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:52.551928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.552380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.553171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.553606 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.719198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:52.719979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:52.726916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.727464 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.728532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:52.729061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:52.795753 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.808494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-363143f9-52c9-426a-aa45-7d981b0ffd21 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.271785 Nov 03 02:04:52.810218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 287/558] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:52 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:52.979613 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.989360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.991392 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:52.992843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-82a92d90-9003-4bf0-84da-e01c1877f5e7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.278668 Nov 03 02:04:53.003647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 272/559] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:52 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:53.134743 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:53.135357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:53.142706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.143151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.144235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.145458 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.350410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:53.351271 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:53.362637 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.369944 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.369944 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.369944 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.532990 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:53.546875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-17e5a670-25da-4d7a-b81c-848aeef2e559 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.415761 Nov 03 02:04:53.550175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 288/560] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:53 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:53.563157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:53.565443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:53.572362 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.573040 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.573930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.574667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.712718 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:53.720357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-890cbf27-798e-4dd6-9c9c-a30f58a62490 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.375304 Nov 03 02:04:53.721168 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 273/561] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:53 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:53.726242 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:53.728495 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:53.733123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.733860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.734668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.735290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.761632 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:04:53.859204 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:53.869956 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3ba881a6-7304-461f-83bc-5bc2c791bd4c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.317267 Nov 03 02:04:53.870591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 289/562] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:53 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:53.894803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:53.898813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:53.904542 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.905002 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:53.906258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:53.906697 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.231425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-13c4f755-e403-43fe-b06b-ee3671e40b7f tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 204 len: 0 microversion: 2.1 time: 0.508399 Nov 03 02:04:54.232725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 274/563] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:04:53 2021] DELETE /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:04:54.240143 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:54.241118 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:54.250104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.250999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.258090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.258090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.288618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:54.297317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-266677ba-2417-44df-a958-2180789ef63d tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1314 microversion: 2.1 time: 0.425559 Nov 03 02:04:54.306176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 290/564] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:53 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:54.306176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:54.306176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:54.310277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.311071 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.312175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.313017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.689267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:54.696063 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:54.713220 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1c9be95f-b454-424c-a9de-fa4ea74dae67 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.413818 Nov 03 02:04:54.718215 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 291/565] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:54 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:54.722734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:54.723582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:54.725275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:54.727335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:54.728610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0b6a7d5e-a18c-4701-8ad8-6ecfea7844fc tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.494548 Nov 03 02:04:54.732585 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 275/566] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:54 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:54.742780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:54.748564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:54.750790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.751231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.752461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.753308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.757661 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.758258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:54.759149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:54.759690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.005505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:55.013763 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a2f5f9f8-b5de-44fe-aa67-5a5d057062b3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.274474 Nov 03 02:04:55.014945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 276/567] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:54 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:55.023224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:55.023820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:55.034662 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:55.035603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.036055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.037057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.037477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.043674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b74279e4-24cb-47ce-8e45-c72336c9dd6f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.324507 Nov 03 02:04:55.047171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 292/568] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:54 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:55.222856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:55.230912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c2c2740b-4d86-4400-a73c-70f961e76e67 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.215461 Nov 03 02:04:55.235991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 277/569] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:55 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:55.319604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:55.324784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:55.333065 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.333513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.334328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.334935 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.483825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:55.498524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b4a63568-e458-4f8f-b556-d727b603a26f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1464 microversion: 2.1 time: 0.182802 Nov 03 02:04:55.523610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 293/570] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:55 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:55.542231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:55.542231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:55.558423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.563084 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.568124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.568124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.598693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:04:55.749934 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:55.750877 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:55.762773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.763573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.764390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.764819 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.951383 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:55.958894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9c57ea41-55b3-4aed-9e81-6d03bc62076c tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 204 len: 0 microversion: 2.1 time: 0.421529 Nov 03 02:04:55.960449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 278/571] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:04:55 2021] DELETE /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:04:55.963812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c5dc90d2-6fa0-4323-8cba-1f847dcc93cc tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.218369 Nov 03 02:04:55.974401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 294/572] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:55 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:55.974550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:55.974550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:55.979689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.980135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.981052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:55.981168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:55.981684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:55.981886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:56.000221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.002340 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.006175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.006863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.281955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.291669 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.306374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.306374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d73e9591-53ce-4686-88fc-a3088620decf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.331731 Nov 03 02:04:56.306374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 279/573] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:55 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:56.306374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:56.307030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:56.314108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.315030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.316616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.317306 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.320493 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.332403 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bec3a9db-78ca-4f7b-a699-247cb91ba4c4 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.366786 Nov 03 02:04:56.338092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 295/574] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:55 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:56.338092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:56.338092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:56.344610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.345332 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.346335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.346905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.572476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.576748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.586970 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c6ad3c13-bab9-46a8-ad91-12d6d274cc8f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.290325 Nov 03 02:04:56.588105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d13697b7-210e-48f7-a625-530ddf10ac23 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.253677 Nov 03 02:04:56.589190 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 296/575] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:56 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:56.591013 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 280/576] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:56 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:56.616801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:56.617470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:56.626177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.626947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.627745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.628187 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.791235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:56.800129 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-914aaf8a-73c9-47e1-94a5-f6e4ec27c42a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.209299 Nov 03 02:04:56.801133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 297/577] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:56 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:56.981972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:56.982834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:56.988814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.989255 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:56.990041 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:56.990502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.145984 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.155920 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-28f2595d-1c27-4160-8644-584b82bab40d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.177988 Nov 03 02:04:57.157037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 281/578] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:56 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:57.316732 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:57.317339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:57.323604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.324297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.324746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.325767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.355489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:57.356114 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:57.372573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.375325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.376138 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.378291 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.608437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.611743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.620386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.621432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-30ffdd98-4702-4c9c-871f-0f7b5f149459 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.269986 Nov 03 02:04:57.621939 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.623127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 282/579] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:57 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:57.629886 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:57.630831 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:57.638972 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2b81f50a-3576-4c6b-b335-f302e33fb9f0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.326458 Nov 03 02:04:57.643038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 298/580] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:57 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:04:57.643522 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.644223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.645268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.645773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.647875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:57.648628 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:57.662301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.662923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.663721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.664148 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.936975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.940570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:57.949634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e19521f9-9f0f-43a3-8342-6dcf728813b5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.305395 Nov 03 02:04:57.950888 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2358bd8f-11cc-42bd-b6ac-4912437a208b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.325744 Nov 03 02:04:57.951622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 283/581] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:57 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:57.956741 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-fdaa4cf6-0995-41e6-9fa6-ce7a1931084e req-95ca6b8c-055d-4f85-a4a7-85d7d7ed7810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b0b0ce-2322-4f89-9a79-3efd949ae8ce", "name": "network-vif-plugged", "status": "completed", "tag": "ff09ef64-e5d7-4f1b-a870-3f00abdc5961"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:04:57.958803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:04:57.958803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:04:57.960802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 299/582] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:57 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:57.965807 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-fdaa4cf6-0995-41e6-9fa6-ce7a1931084e req-95ca6b8c-055d-4f85-a4a7-85d7d7ed7810 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.966310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-fdaa4cf6-0995-41e6-9fa6-ce7a1931084e req-95ca6b8c-055d-4f85-a4a7-85d7d7ed7810 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.973863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:57.975220 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:57.977997 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-fdaa4cf6-0995-41e6-9fa6-ce7a1931084e req-95ca6b8c-055d-4f85-a4a7-85d7d7ed7810 service nova] Creating event network-vif-plugged:ff09ef64-e5d7-4f1b-a870-3f00abdc5961 for instance e8b0b0ce-2322-4f89-9a79-3efd949ae8ce on hv-cinder-81561 Nov 03 02:04:57.982284 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.983478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-fdaa4cf6-0995-41e6-9fa6-ce7a1931084e req-95ca6b8c-055d-4f85-a4a7-85d7d7ed7810 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030508 Nov 03 02:04:57.985979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 284/583] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:04:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:04:57.987181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:57.988075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:57.988523 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.131111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:58.136963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-60b0704a-34be-465c-b52e-e0172a7e926e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.174978 Nov 03 02:04:58.138870 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 300/584] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:57 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:58.173582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:58.174456 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:58.187458 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.188020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.188862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.189236 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.334803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:58.343985 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5933c05f-afe3-42c6-9474-80a2d0741b1d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.174289 Nov 03 02:04:58.344570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 285/585] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:58 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:58.639875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:58.641271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:58.649545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.650299 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.651092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.651524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.662710 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:58.669174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:58.676667 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.677108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.677920 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.678402 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.865823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:58.873664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9eee8488-f38a-4a7e-8f61-8d4413bd3e4e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.237937 Nov 03 02:04:58.883582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:58.883720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 301/586] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:58 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:58.886527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:58.888691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:58.890129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4f00245b-b4e8-40cb-a4d0-3c51020557eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.231122 Nov 03 02:04:58.890787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 286/587] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:58 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:04:58.967952 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:58.968213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:58.968571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:58.968684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:58.974505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.974691 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.975002 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.975134 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.975779 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.975883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:58.976212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:58.976322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.183677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:59.186907 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:59.193140 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-98a2c777-f833-46be-8f2d-a3cb62db4840 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.229078 Nov 03 02:04:59.193828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 287/588] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:58 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:59.194420 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3e219d0e-d59c-42fa-9bfc-24f1a02f299c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.230282 Nov 03 02:04:59.194998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 302/589] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:58 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:59.198405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:59.199082 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:59.209094 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.209542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.210394 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.210854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.354849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:59.360936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:59.361568 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:59.363226 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-22efb342-4522-4ecc-bcd5-173730fab11d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.168299 Nov 03 02:04:59.363807 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 288/590] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:59 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:59.367293 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.367734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.368501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.368963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.502477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:04:59.510367 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d1c49bce-120b-49cb-878f-9fc3971293c3 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.152830 Nov 03 02:04:59.518178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 303/591] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:59 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:04:59.891456 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:59.892068 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:59.898366 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.898812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.899588 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.900041 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.908646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:04:59.909503 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:04:59.917442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.919258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:04:59.919258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:04:59.919258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.125084 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.133717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d2c9ba56-4ce1-409b-97b4-9848c33a3f33 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.245429 Nov 03 02:05:00.133717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 289/592] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:04:59 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:00.137101 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.145434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.146894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.148038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-dcb8e7df-f1fc-4fb9-9a94-cc84b563c6a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.243060 Nov 03 02:05:00.148623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 304/593] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:04:59 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:00.211320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:00.211912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:00.213898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:00.214537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:00.218125 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.218600 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.219384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.219818 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.220639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.221079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.224546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.224839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.462611 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.466459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.474989 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-82add7c2-5eec-4f0a-9d5c-cec9279bd9cc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.267433 Nov 03 02:05:00.475425 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-55c75107-8ea7-4de1-a984-f3f2f6583779 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.265869 Nov 03 02:05:00.476497 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 290/595] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:00 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:00.477250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 305/595] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:00 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:00.482378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:00.483237 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:00.489806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.495461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.495461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.495461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.526999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:00.527598 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:00.536050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.537133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.537356 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:00.537816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:00.748088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.755349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7c8e0790-8fa9-49b1-bce3-66b95f03234c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.277648 Nov 03 02:05:00.756176 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 291/596] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:00 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:00.776459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:00.785372 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-89f2fecd-82fb-4aa4-87fb-766aad199155 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.261922 Nov 03 02:05:00.786064 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 306/597] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:00 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:01.151900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:01.152900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:01.160058 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.160591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.161459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.161956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.166873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:01.167481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:01.173650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.180674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.180674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.180674 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.416288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:01.425274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4ad5a769-7185-4757-8dd5-1c65489c270a tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.277679 Nov 03 02:05:01.430849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 292/598] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:01 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:01.453488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:01.462666 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:01.464378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:01.465685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8deb7552-94ec-4bfa-9759-7071f2e7d5c3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.302471 Nov 03 02:05:01.466320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 307/599] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:01 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:01.493790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:01.494629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:01.504288 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:01.504288 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:01.504525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.504525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.504525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.504525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.506442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.507364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.508382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.509025 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.733551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:01.741107 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4e6d96f2-5311-4518-a90f-7b5f1bb1a4f9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.249745 Nov 03 02:05:01.742018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 308/600] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:01 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:01.748837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:01.757239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cfe5453b-31f1-48bf-aec8-f7eb9d1e1e7a tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.267711 Nov 03 02:05:01.762080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 293/601] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:01 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:01.772368 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:01.772971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:01.779388 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.779885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.780654 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.781213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.806466 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:01.807277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:01.827395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.827395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:01.827395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:01.827395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.271876 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:02.277114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-38cf7d5f-5506-4b13-a33e-92577035c525 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.508344 Nov 03 02:05:02.278405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 309/602] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:01 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:02.290197 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:02.299232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5ff41b71-1e1d-4ced-aece-dafe7df8cddf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.496458 Nov 03 02:05:02.299891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 294/603] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:01 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:02.444155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:02.444910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:02.451004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.451444 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.452213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.452644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.483722 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:02.494182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:02.494182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.494182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.494182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.494654 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.685282 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:02.693721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d6d18eed-4a55-49ca-b11f-f8f299f83a77 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.253171 Nov 03 02:05:02.699661 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 310/604] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:02 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:02.745245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:02.758506 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:02.759669 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:02.760189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:02.762066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:02.764037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0d7f0b62-3087-4f16-a22f-e3ed13a4b09b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.284560 Nov 03 02:05:02.766856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 295/605] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:02 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:02.768884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.770934 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.775676 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.776311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.786345 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:02.786345 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:02.798970 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.799418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:02.800412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:02.801007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.023360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:03.032374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c87ccce2-cb14-470e-aafd-718a62d6c0c5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.277274 Nov 03 02:05:03.036616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:03.042715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 311/606] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:02 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:03.046081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8e534bb9-d8a6-466c-870a-8a55e3f465cb tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.272933 Nov 03 02:05:03.046742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 296/607] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:02 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:03.295089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:03.296507 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:03.315910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.316671 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.317081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:03.317694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:03.318051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.318715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.324205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.324905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.325856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.326465 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.572197 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:03.581977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1299915e-5dd9-4b58-97ed-0fc393599f45 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.290942 Nov 03 02:05:03.586172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 312/608] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:03 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:03.600000 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:03.610491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-53bb2e7a-407a-4f24-a019-a855f186c942 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.296680 Nov 03 02:05:03.611163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 297/609] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:03 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:03.722200 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:03.723253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:03.731233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.733155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.734274 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.734875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.783721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:03.784339 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:03.790623 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.791383 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:03.792380 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:03.792885 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.108899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.113268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.121682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0fab4840-3ab4-40dd-9cfd-1c5a8171edff tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.403459 Nov 03 02:05:04.123152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 313/610] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:03 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:04.135526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:04.136643 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:04.140078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.150453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.150453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-944e37f2-0d51-4250-a2db-f18ba48655fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.363426 Nov 03 02:05:04.150453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 298/611] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:03 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:04.151036 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.151036 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.151036 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.151036 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.151399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:04.151793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:04.161761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.162236 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.163044 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.163478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.465032 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.473566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f1e2118f-1ad8-404e-81af-dc43ac001684 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.349146 Nov 03 02:05:04.478214 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 314/612] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:04 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:04.487685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.496221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8fd0287a-443f-43ec-9f65-e3c5cc0e5fb0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.350821 Nov 03 02:05:04.498028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 299/613] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:04 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:04.599867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:04.600696 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:04.607991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.608514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.609444 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.610067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.628643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:04.629787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:04.644924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.645673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.646672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:04.649510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:04.835038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.850910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5764fe3f-0bbc-465f-ad73-f318ea2a05a3 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.254763 Nov 03 02:05:04.851513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 315/614] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:04 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:04.953057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:04.965098 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f40441f2-42da-44f4-a95f-afd11d3b4dbf tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.341305 Nov 03 02:05:04.967146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 300/615] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:04 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:05.141322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:05.142402 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:05.149834 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.150495 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.151486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.151872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.168429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:05.176405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:05.183526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.188436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.196275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.196998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.411427 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:05.419049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-87bc94a8-11fe-4707-bf67-5950ea97531e tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.282079 Nov 03 02:05:05.420385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 316/616] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:05 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:05.450661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:05.461048 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:05.463092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:05.464441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b233346a-de1d-4a42-aa76-f39808f5f8e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.299837 Nov 03 02:05:05.465204 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 301/617] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:05 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:05.491405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:05.492227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:05.498697 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.499140 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.499906 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.500336 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.521123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:05.523907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:05.546363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.547205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.548626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.551219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.692015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:05.707381 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-03cb50bd-f038-41b5-88df-3ee2e193ba48 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.218839 Nov 03 02:05:05.709168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 317/618] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:05 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:05.803083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:05.813218 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-33969b68-a2b2-441d-92fc-f937e15f7cff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.302005 Nov 03 02:05:05.814368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 302/619] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:05 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:05.868799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:05.869979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:05.882783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.883649 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.884610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.885406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.983983 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:05.984692 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:05.993949 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.995765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:05.997875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:05.998456 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.353122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:06.365835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-984715fa-38df-44ab-a2ff-347732de5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.500579 Nov 03 02:05:06.367048 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 318/620] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:05 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:06.423333 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:06.438064 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c8c90ba7-8857-442e-b735-91d9b46b461d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.458402 Nov 03 02:05:06.441788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:06.442550 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:06.448791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.449386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.450823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.451514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.455373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 303/621] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:05 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:06.483568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:06.484583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:06.491122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.491656 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.492540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.493184 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.778922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:06.788724 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0ded11a5-e07b-4e8a-b33f-e56e9692c44f tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.354228 Nov 03 02:05:06.789258 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 319/622] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:06 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:06.803675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:06.809749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:06.809749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:06.813740 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.814411 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.815464 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.816109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.822852 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:06.826476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:06.827664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3ca21a80-bcba-4aaa-a44a-718bcb453966 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.348188 Nov 03 02:05:06.836186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 304/623] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:06 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:06.836186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:06.836186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:06.841539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.842066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:06.843277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:06.843408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:07.182699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:07.189113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:07.191531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c0a4ce3c-9663-4d18-b879-6cb355c9defc tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.361966 Nov 03 02:05:07.192302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 305/624] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:06 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:07.207263 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3a116755-953a-4880-8b2e-3ac7586cc3c9 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.405689 Nov 03 02:05:07.209075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 320/625] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:06 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:07.386793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:07.386793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:07.394925 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:07.395376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:07.396213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:07.396592 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:07.456103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:07.456804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:07.467011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:07.467011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:07.467011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:07.467011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.091566 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.099483 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ff945a4c-4aec-4e8d-a822-02d5216799ea tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.720536 Nov 03 02:05:08.100416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 306/626] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:07 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:08.113494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:08.114413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:08.120761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.121209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.122634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.123071 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.160156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.177856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5ef8c273-7a2f-4eb7-9ce1-2199a0f16a72 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.725285 Nov 03 02:05:08.178496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 321/627] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:07 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:08.192083 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:08.192783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:08.199425 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.204570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.204570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.204570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.396570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.404315 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-255c7fe5-5656-4349-90b1-f74015492cb0 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.302934 Nov 03 02:05:08.404873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 307/628] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:08 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:08.409654 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:08.410275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:08.415951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.416346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.420552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.421100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.584893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.593123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.594646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.595796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0bd64d09-1e69-437b-b329-145040428b95 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.415800 Nov 03 02:05:08.596355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 322/629] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:08 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:08.600806 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:08.601485 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:08.608859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.609305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.610170 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:08.611308 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:08.829584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.839427 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-42241767-30e0-4ceb-bc9d-7cbc4ee6fcd4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1568 microversion: 2.1 time: 0.433490 Nov 03 02:05:08.849103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 308/630] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:08 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1568 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:08.924061 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:08.932256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5b48ea52-4ec5-441f-ba8e-943de25b17d1 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1318 microversion: 2.1 time: 0.334700 Nov 03 02:05:08.932831 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 323/631] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:08 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:09.116750 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:09.117357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:09.123773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.124217 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.124995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.125422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.194580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:09.195509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:09.201860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.202537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.203506 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.204099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.482068 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:09.490428 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2823be72-a473-4e5c-9c45-3fa8492a9f8b tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.377157 Nov 03 02:05:09.491098 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 309/632] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:09 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:09.496300 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:09.498917 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:09.507721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.508593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.509576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.510340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.522820 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:09.530936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5669a28f-d099-4a24-92c4-6ba8b22007e1 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1512 microversion: 2.1 time: 0.339914 Nov 03 02:05:09.533723 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 324/633] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:09 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:09.615387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:09.616181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:09.622291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.628114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.628114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.628114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.862778 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:09.875510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0a019f7a-ea2e-4340-90bc-018cc15bb0bb tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1470 microversion: 2.1 time: 0.382933 Nov 03 02:05:09.881330 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 310/634] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:09 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1470 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:09.894614 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:09.898069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:09.910274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.915505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.921664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:09.921664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:09.982761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:09.992024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:09.995341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:09.998365 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cf0d08f0-9f8d-46a6-9d57-d213e2f829e6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.387506 Nov 03 02:05:09.999118 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 325/635] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:09 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:10.007707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:10.009640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:10.022838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.022838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.028408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.030591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.323825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:10.339324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-93dae776-f107-40d5-80c0-751fd63157e7 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1548 microversion: 2.1 time: 0.452720 Nov 03 02:05:10.339324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 311/636] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:09 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1548 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:10.358297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:10.359035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:10.366242 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.369224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.369224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.369224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.442559 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:10.464955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-62d9ad1f-5028-463a-85c7-61d31852bec3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1508 microversion: 2.1 time: 0.452316 Nov 03 02:05:10.464955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 326/637] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:09 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:10.509755 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:10.509755 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:10.520501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.522338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.525859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.526283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.530073 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] HTTP exception thrown: Cannot 'detach_volume' instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe while it is in vm_state rescued Nov 03 02:05:10.531078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Returning 409 to user: Cannot 'detach_volume' instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe while it is in vm_state rescued {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:05:10.533405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f5b5b705-4444-4546-8668-878083e126a9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments/f234c42a-649a-4565-9799-2f5a6af3a43f" status: 409 len: 152 microversion: 2.1 time: 0.178932 Nov 03 02:05:10.534494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 312/638] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:05:10 2021] DELETE /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments/f234c42a-649a-4565-9799-2f5a6af3a43f => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 02:05:10.542166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:10.542867 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:10.549994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.550691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.552624 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.553238 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.788119 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:10.811079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5530d3ec-2ea8-49b9-82bc-c41edc39b110 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.307851 Nov 03 02:05:10.812270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 327/639] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:10 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:10.823015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:10.823901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:10.830974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.831597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.832553 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.833145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.925053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e2576e84-315a-4569-ac0c-2bc801a835a0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action" status: 202 len: 0 microversion: 2.1 time: 0.385729 Nov 03 02:05:10.928086 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 313/640] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:05:10 2021] POST /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:05:10.933291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:10.946037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-e6463a8c-9743-4da7-ac18-36d2c0ef4d6a req-c4afd485-28df-4274-925b-7c175a7586dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90dea4f-ac73-4fbb-b103-80101d052586", "name": "network-vif-deleted", "tag": "171a824a-6709-4440-afd6-b8fcfc397fc3"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:10.947712 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:10.947712 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:10.948264 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8c484eb0-d211-4a0f-b456-7110953dc82b tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1470 microversion: 2.1 time: 0.128151 Nov 03 02:05:10.953401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 328/641] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:10 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1470 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:10.961721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-e6463a8c-9743-4da7-ac18-36d2c0ef4d6a req-c4afd485-28df-4274-925b-7c175a7586dc service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.962200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-e6463a8c-9743-4da7-ac18-36d2c0ef4d6a req-c4afd485-28df-4274-925b-7c175a7586dc service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.971650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:10.975519 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-e6463a8c-9743-4da7-ac18-36d2c0ef4d6a req-c4afd485-28df-4274-925b-7c175a7586dc service nova] Creating event network-vif-deleted:171a824a-6709-4440-afd6-b8fcfc397fc3 for instance a90dea4f-ac73-4fbb-b103-80101d052586 on hv-cinder-81561 Nov 03 02:05:10.976267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:10.983127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-e6463a8c-9743-4da7-ac18-36d2c0ef4d6a req-c4afd485-28df-4274-925b-7c175a7586dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056214 Nov 03 02:05:10.991459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 314/642] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:10.991560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.991560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.992522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:10.993047 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:10.993190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:10.993895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:11.006076 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.006555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.007748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.007854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.081549 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:11.095582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-31db2f1e-ec0f-425f-8ff8-26638fdac0f1 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1428 microversion: 2.1 time: 0.140920 Nov 03 02:05:11.096132 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 329/643] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:10 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1428 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:11.109003 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:11.109602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:11.119432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.120086 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.124234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.124234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.711955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:11.721083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dd546a6f-e00b-4793-966d-4922a2672dde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1556 microversion: 2.1 time: 0.732320 Nov 03 02:05:11.721854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 315/644] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:10 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1556 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:11.727584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-5654c5f5-f9c8-484c-b335-fb8e50d1d624 req-a7e56d38-738b-43ee-9229-f11eb51e1830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9dcb982-e537-49db-aa7e-2a5060b12d2a", "name": "network-vif-deleted", "tag": "c6cc6d29-8315-4b6b-bd7c-54586185d3f8"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:11.730156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:11.730156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:11.738297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-5654c5f5-f9c8-484c-b335-fb8e50d1d624 req-a7e56d38-738b-43ee-9229-f11eb51e1830 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.739108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-5654c5f5-f9c8-484c-b335-fb8e50d1d624 req-a7e56d38-738b-43ee-9229-f11eb51e1830 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.755446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-5654c5f5-f9c8-484c-b335-fb8e50d1d624 req-a7e56d38-738b-43ee-9229-f11eb51e1830 service nova] Creating event network-vif-deleted:c6cc6d29-8315-4b6b-bd7c-54586185d3f8 for instance d9dcb982-e537-49db-aa7e-2a5060b12d2a on hv-cinder-81561 Nov 03 02:05:11.760501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:11.762787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-5654c5f5-f9c8-484c-b335-fb8e50d1d624 req-a7e56d38-738b-43ee-9229-f11eb51e1830 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039405 Nov 03 02:05:11.763565 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 316/645] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:11.773405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:11.774940 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:11.787250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-315c522b-26e0-4ecf-98a5-69e04a9603e2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.679202 Nov 03 02:05:11.787250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 330/646] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:11 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:11.828206 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:11.828880 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:11.842391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.842843 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.843651 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.844080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.971978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:11.973580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:11.982458 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.983270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:11.984764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:11.985991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.051528 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.052249 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.053715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lazy-loading 'fault' on Instance uuid a90dea4f-ac73-4fbb-b103-80101d052586 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:05:12.198546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:12.212980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-238d78a6-32de-4a99-a080-df9c46a82629 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 200 len: 1309 microversion: 2.1 time: 0.245034 Nov 03 02:05:12.214475 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 331/647] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:11 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:12.220713 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:12.221347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:12.222119 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:12.230535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3072bd0b-2575-4054-89b1-d8654d6c1d78 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.406643 Nov 03 02:05:12.240622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 317/648] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:11 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:12.240801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.240801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.240801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.240801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.265075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.265521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.265963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lazy-loading 'fault' on Instance uuid d9dcb982-e537-49db-aa7e-2a5060b12d2a {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:05:12.361151 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-5c135d9a-4143-4c85-b6f6-44f99c745452 req-2a2c0682-d92e-494b-97b9-6b5143aaaa17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "name": "network-vif-plugged", "status": "completed", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:12.363927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:12.363927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:12.373115 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ec794b22e4b19aaa6fcad1856236a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b437a261d1c541edb0a4b366f3034ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:12.381687 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-5c135d9a-4143-4c85-b6f6-44f99c745452 req-2a2c0682-d92e-494b-97b9-6b5143aaaa17 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.382035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-5c135d9a-4143-4c85-b6f6-44f99c745452 req-2a2c0682-d92e-494b-97b9-6b5143aaaa17 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.384748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9afe6f89-5b50-41e8-81b5-850f25936100 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 200 len: 1304 microversion: 2.1 time: 0.168319 Nov 03 02:05:12.385332 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 332/649] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:12 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:12.421994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-5c135d9a-4143-4c85-b6f6-44f99c745452 req-2a2c0682-d92e-494b-97b9-6b5143aaaa17 service nova] Creating event network-vif-plugged:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:05:12.422230 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c0bdad0-d3d4-4322-9862-0c47d8479237"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:12.423401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:12.428219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-5c135d9a-4143-4c85-b6f6-44f99c745452 req-2a2c0682-d92e-494b-97b9-6b5143aaaa17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070494 Nov 03 02:05:12.429159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 318/650] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:05:12.433871 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.434739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.435878 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.436779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.744080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:12.745484 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:12.761706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.763101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:12.769748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:12.773399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.037271 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:13.054180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b247ea11-016f-46c3-9ba1-0bd3665d81f9 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1556 microversion: 2.1 time: 0.317377 Nov 03 02:05:13.060915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 319/651] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:12 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1556 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:13.073430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:13.075594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:13.087561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.088839 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.089248 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.089932 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.241266 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:13.250902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:13.252341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:13.253482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-abad2bf6-7d8d-472c-a0b4-ae45063ef079 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.189996 Nov 03 02:05:13.254033 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 320/652] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:13 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:13.259425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:13.260179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: a90dea4f-ac73-4fbb-b103-80101d052586] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:13.267420 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.267919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.268750 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.269174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.283019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] HTTP exception thrown: Instance a90dea4f-ac73-4fbb-b103-80101d052586 could not be found. Nov 03 02:05:13.283756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Returning 404 to user: Instance a90dea4f-ac73-4fbb-b103-80101d052586 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:05:13.284580 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5d9b2930-4b50-45e7-b6f2-d595483ff451 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586" status: 404 len: 111 microversion: 2.1 time: 0.029472 Nov 03 02:05:13.285199 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 321/653] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:13 2021] GET /compute/v2.1/servers/a90dea4f-ac73-4fbb-b103-80101d052586 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:05:13.291716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:13.291716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:13.299545 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.302284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.302284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.302284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.466353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:13.474776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d2b12148-6fe2-4f24-b13a-d84e25519d9a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1357 microversion: 2.1 time: 0.188547 Nov 03 02:05:13.475840 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 322/654] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:13 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:13.481269 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:13.481878 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] [instance: d9dcb982-e537-49db-aa7e-2a5060b12d2a] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:13.486567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f083029a-55d1-487b-abe3-6aae303217ec tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067937 Nov 03 02:05:13.487586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 333/655] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:05:12 2021] POST /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 194 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:13.491753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.492275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.493235 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:13.493602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:13.520378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] HTTP exception thrown: Instance d9dcb982-e537-49db-aa7e-2a5060b12d2a could not be found. Nov 03 02:05:13.521014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] Returning 404 to user: Instance d9dcb982-e537-49db-aa7e-2a5060b12d2a could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:05:13.521912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5a093198-8023-43e7-b071-c3daa61c2727 tempest-VolumesNegativeTest-845221265 tempest-VolumesNegativeTest-845221265-project] 10.222.0.30 "GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a" status: 404 len: 111 microversion: 2.1 time: 0.045040 Nov 03 02:05:13.523960 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 323/656] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:13 2021] GET /compute/v2.1/servers/d9dcb982-e537-49db-aa7e-2a5060b12d2a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:05:14.079785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:14.081342 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:14.089241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.089899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.091261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.091764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.273233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:14.273842 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:14.284128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.286129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.288249 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.289062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.355477 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.368921 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ffaa2405-ba96-47ba-90a7-86b4adc8ac08 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1556 microversion: 2.1 time: 0.295327 Nov 03 02:05:14.375594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 334/657] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:14 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1556 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:14.502870 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:14.508260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:14.523828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.525559 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.526362 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.527387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.530733 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.536147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.537902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.539293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7b17dc64-f59e-4539-89b9-8fc099b1e53a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.271617 Nov 03 02:05:14.540347 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 324/658] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:14 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:14.702929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.702929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3a5f460c-ae4f-45be-9796-6763a3c28917 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1547 microversion: 2.1 time: 0.209715 Nov 03 02:05:14.702929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 335/659] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:14 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1547 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:14.719312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:14.721309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:14.727521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.733631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.733631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.733631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.911234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.925060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-57136fef-51be-4319-b6c2-f8694bce3cfc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1547 microversion: 2.1 time: 0.207408 Nov 03 02:05:14.925060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 325/660] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:14 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1547 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:14.937329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:14.941171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:14.941171 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:05:14.942556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:14.943417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Searching by: {'deleted': False, 'project_id': 'f13a412251cf4add8e72d0811966ade4'} {{(pid=123012) get_all /opt/stack/nova/nova/compute/api.py:2905}} Nov 03 02:05:14.950302 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.950839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:14.951736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:14.952266 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.077432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.multi_cell_list [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123012) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 03 02:05:15.187155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-57612210-6a1e-462a-ab6e-e948fe499e60 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.254030 Nov 03 02:05:15.187745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 336/661] 10.222.0.30 () {58 vars in 1124 bytes} [Wed Nov 3 02:05:14 2021] GET /compute/v2.1/servers => generated 342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:15.197609 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:15.198265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:15.204216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:15.204656 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.205446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:15.205912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.344323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:15.349074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e6c7ddd1-03b7-481f-8c17-5226a0bbf22e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1547 microversion: 2.1 time: 0.155190 Nov 03 02:05:15.349637 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 326/662] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:15 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:15.386063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:15.387312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:15.394006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:15.394514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.399110 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:15.399110 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.556684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:15.557329 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:15.561521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:15.564314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:15.565119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.566886 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:15.567560 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:15.572130 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d50010f5-dcde-4e86-8843-54b0fc196364 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1556 microversion: 2.1 time: 0.189617 Nov 03 02:05:15.573552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 337/663] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:15 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:15.581487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:05:15.581678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: Wed Nov 3 02:05:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:05:15.735486 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:15.744231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:15.746799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:15.748047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1dc56ddd-2c34-4793-b63c-5ef1f9e96530 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.195197 Nov 03 02:05:15.748858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 327/664] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:15 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:16.590196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:16.590805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:16.597401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:16.602012 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:16.602832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:16.607179 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:16.766911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:16.768257 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:16.799607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:16.800344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:16.803273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:16.803982 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:16.810713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:16.827585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fd902b22-beb7-47fe-bb01-d123d3df6793 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1556 microversion: 2.1 time: 0.240326 Nov 03 02:05:16.829671 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 338/665] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:16 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1556 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:16.840775 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-e85184ac-1d1c-4ac3-a682-94318d8a63ae req-b4134302-1205-4f1a-baf0-f8946c7fcf50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "name": "network-vif-plugged", "status": "completed", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:16.842802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:16.842802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:05:16.853450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e85184ac-1d1c-4ac3-a682-94318d8a63ae req-b4134302-1205-4f1a-baf0-f8946c7fcf50 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:16.853888 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e85184ac-1d1c-4ac3-a682-94318d8a63ae req-b4134302-1205-4f1a-baf0-f8946c7fcf50 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:16.872347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-e85184ac-1d1c-4ac3-a682-94318d8a63ae req-b4134302-1205-4f1a-baf0-f8946c7fcf50 service nova] Creating event network-vif-plugged:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:05:16.878815 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-e85184ac-1d1c-4ac3-a682-94318d8a63ae req-b4134302-1205-4f1a-baf0-f8946c7fcf50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046499 Nov 03 02:05:16.882328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 339/666] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:17.051905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:17.061312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:17.063299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:17.064601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7944254c-0e93-41ad-868a-ceadc89b38e0 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.302603 Nov 03 02:05:17.065502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 328/667] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:16 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:17.858574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:17.859297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:17.884872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:17.885382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:17.886960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:17.887693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:18.083767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:18.085507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:18.100094 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:18.100546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:18.101334 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:18.101765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:18.138161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:18.204728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a258e2a8-beef-4fff-bbdf-36cb9a28ee68 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1562 microversion: 2.1 time: 0.356517 Nov 03 02:05:18.218673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 340/668] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:17 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1562 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:18.454796 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:18.464190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:18.467233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:18.470699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a2dbb3a7-9da4-4f44-9851-ddb768de318e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.390361 Nov 03 02:05:18.475309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 329/669] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:18 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:05:18.537452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:18.538221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:18.548946 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:18.549475 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:18.550520 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:18.551133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:18.918121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lazy-loading 'services' on Instance uuid fe6fe0cb-1e19-4f19-84b4-15e0d56010fe {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:05:19.004907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d17ff2b-cd01-4655-8193-0ab6d48f04ff"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:19.004907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:19.009894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:19.010440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:19.011231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:19.012841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:19.338082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-996bcdde-de85-4e26-84c3-e43367ede49b tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments/f234c42a-649a-4565-9799-2f5a6af3a43f" status: 202 len: 0 microversion: 2.1 time: 0.805014 Nov 03 02:05:19.338955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 341/670] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:05:18 2021] DELETE /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments/f234c42a-649a-4565-9799-2f5a6af3a43f => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:05:19.539528 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ba290d2d-9dc1-4428-aff9-f498b3e7963a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Action: 'create', calling method: .version_select at 0x7f30b7da3a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1404425520"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:19.563783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-ba290d2d-9dc1-4428-aff9-f498b3e7963a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Getting quotas for project 136f0a28eb6d4e108836305888f1fcb4. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:05:19.567196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-ba290d2d-9dc1-4428-aff9-f498b3e7963a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Getting quotas for user 77f07b2b1d72456fb282fd434d73e946 and project 136f0a28eb6d4e108836305888f1fcb4. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:05:19.992334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-ba290d2d-9dc1-4428-aff9-f498b3e7963a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Getting quotas for project 136f0a28eb6d4e108836305888f1fcb4. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:05:19.996318 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-ba290d2d-9dc1-4428-aff9-f498b3e7963a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Getting quotas for user 77f07b2b1d72456fb282fd434d73e946 and project 136f0a28eb6d4e108836305888f1fcb4. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:05:20.009959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ba290d2d-9dc1-4428-aff9-f498b3e7963a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.669714 Nov 03 02:05:20.019272 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 342/671] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Nov 3 02:05:19 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:20.036623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c0bdad0-d3d4-4322-9862-0c47d8479237"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:20.038181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:20.048579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.049163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.050971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.052240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.146375 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] HTTP exception thrown: Invalid volume: volume 2c0bdad0-d3d4-4322-9862-0c47d8479237 is already attached to instances: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce Nov 03 02:05:20.147651 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Returning 400 to user: Invalid volume: volume 2c0bdad0-d3d4-4322-9862-0c47d8479237 is already attached to instances: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:05:20.148330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-370834e1-e792-4aac-8123-4d67812a168f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127960 Nov 03 02:05:20.149053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 343/672] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:05:20 2021] POST /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:05:20.155109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:20.156243 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:20.163039 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.163484 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.164264 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.164693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.201566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-540e8bd1-10e0-4f8c-bd52-cf4a2022fcde tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051348 Nov 03 02:05:20.202124 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 344/673] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:20 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:20.206490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:20.207089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:20.213065 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.213594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.214295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.215906 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.247003 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3ea18533-eb22-40b0-ab3b-139967e62472 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.243076 Nov 03 02:05:20.248335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 330/674] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:05:18 2021] POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments => generated 194 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:05:20.265069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:20.265650 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:20.273417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.273865 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.274676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:20.275350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:20.430781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:20.440885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:20.442666 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:20.443778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-af80bb5d-a6d3-42a6-97b2-faa10cdbebb5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.240546 Nov 03 02:05:20.444621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 345/675] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:20 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:20.697968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lazy-loading 'services' on Instance uuid e8b0b0ce-2322-4f89-9a79-3efd949ae8ce {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:05:21.055499 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-85884dd0-909a-4f5e-ac7d-7d6ad96ccdd7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments/2c0bdad0-d3d4-4322-9862-0c47d8479237" status: 202 len: 0 microversion: 2.1 time: 0.794174 Nov 03 02:05:21.055499 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 331/676] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:05:20 2021] DELETE /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments/2c0bdad0-d3d4-4322-9862-0c47d8479237 => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:05:21.066050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:21.068851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:21.106929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:21.107873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:21.109587 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:21.110041 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:21.152199 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d872c889-9958-415e-8b85-e3e4d2d449b7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092524 Nov 03 02:05:21.153836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 346/677] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:21 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:05:21.213630 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:21.215529 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:21.224883 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:21.225607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:21.226603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:21.227036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:21.259473 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b32c0ac2-e61f-4f94-b278-2d5c5f336642 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049914 Nov 03 02:05:21.267000 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 332/678] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:21 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:05:21.463221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:21.465265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:21.473178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:21.473892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:21.474927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:21.476096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:21.698234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:21.706678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:21.708181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:21.709327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-89e60881-5b0b-4da6-a727-be90cdd45c8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.250220 Nov 03 02:05:21.709871 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 347/679] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:21 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:22.168841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:22.169486 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:22.176677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:22.177344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:22.178338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:22.178768 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:22.216514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-81fce99b-ec49-4810-9a76-d6cbe47c1ce7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055999 Nov 03 02:05:22.217191 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 333/680] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:22 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:22.727373 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:22.727962 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:22.734659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:22.735101 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:22.735870 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:22.736301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:22.876416 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:22.884525 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:22.886010 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:22.887733 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-78b3f173-7c67-427d-8008-f64db723b6f8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.164084 Nov 03 02:05:22.888295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 348/681] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:22 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:23.227927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:23.228780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:23.235004 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:23.235492 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:23.236201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:23.236633 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:23.268023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-230f092b-6559-428b-85f9-41c8c2345177 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Nov 03 02:05:23.268603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 334/682] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:23 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:23.905784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:23.906417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:23.912675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:23.913126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:23.913901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:23.914363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:24.063947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:24.075876 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:24.077858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:24.079235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bbb24bed-58fd-44fc-86a4-ddff6f7537d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1809 microversion: 2.20 time: 0.177625 Nov 03 02:05:24.079894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 349/683] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:23 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:24.279852 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:24.281052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:24.287600 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:24.288192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:24.289032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:24.289474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:24.319854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ea208ae3-c83b-4a4f-b096-1c916da978db tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Nov 03 02:05:24.320435 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 335/684] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:24 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:25.100252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:25.101139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:25.108395 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:25.108951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:25.109886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:25.110364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:25.251599 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-257631461", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "326aa7e2-8440-4a6d-838b-7bc4586b4583"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:25.269188 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:25.280507 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:25.282050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:25.283263 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-86e00217-5739-4d1c-a91a-428379638638 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1796 microversion: 2.20 time: 0.187176 Nov 03 02:05:25.284034 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 350/685] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:05:25 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1796 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:05:25.312423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] validate_networks() for [('326aa7e2-8440-4a6d-838b-7bc4586b4583', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:05:25.331177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:25.332338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:25.338501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:25.339172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:25.339964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:25.340572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:25.369851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-97f6c981-fc6b-4596-9a60-5581b9240fbf tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Nov 03 02:05:25.370444 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 351/686] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:25 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:05:25.658791 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:05:25.659219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:05:25.659670 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:05:25.660070 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:05:25.660470 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:05:25.669560 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:25.670006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:25.670842 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:25.671275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:25.687120 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Getting quotas for project 98a980ad0c18487f84e6b1163bde3249. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:05:25.690945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Getting quotas for user 07503c14bcbe43d292e444271688f56f and project 98a980ad0c18487f84e6b1163bde3249. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:05:25.701299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:05:25.703622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:05:25.827844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6b139235-ba80-4665-af6f-aaebb760171d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580426 Nov 03 02:05:25.828488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 336/687] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:05:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:05:25.842163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bea79001-61b4-4d16-b598-2da62c908f03 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:25.842777 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bea79001-61b4-4d16-b598-2da62c908f03 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:25.894932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bea79001-61b4-4d16-b598-2da62c908f03 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:25.903758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bea79001-61b4-4d16-b598-2da62c908f03 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1218 microversion: 2.1 time: 0.068949 Nov 03 02:05:25.912250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 352/688] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:25 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:26.343340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:26.343825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:26.349763 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.350244 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.351010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.351441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.375786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:05:26.380890 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:26.381824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:26.389836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.390318 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.391098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.391532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.420179 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-75bf3296-bfbf-4d51-af60-b386f8341e8c tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Nov 03 02:05:26.420736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 353/689] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:26 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:26.755939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1c2c3add-77f6-4660-bb07-d8006bfc0026 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 204 len: 0 microversion: 2.1 time: 0.416331 Nov 03 02:05:26.756561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 337/690] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:05:26 2021] DELETE /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 02:05:26.765097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:26.765758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:26.772846 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.773328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.774747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.775571 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.921960 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:26.922715 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:26.925146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:26.929052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.929629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.930442 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:26.930898 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:26.939112 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-122608c2-d3f5-4e77-9981-056d4eb4d574 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1509 microversion: 2.1 time: 0.178040 Nov 03 02:05:26.939720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 354/691] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:26 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:26.995207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:27.002885 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e28faab5-48a7-4d13-a8bc-49e1aa052b8d tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1222 microversion: 2.1 time: 0.085544 Nov 03 02:05:27.003440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 338/692] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:26 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:27.431872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:27.432830 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:27.439508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:27.439884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:27.440659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:27.441090 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:27.474407 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-54a3ca7f-5c9a-4265-8096-69223b5ca691 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Nov 03 02:05:27.474987 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 355/693] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:27 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:27.956424 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:27.957603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:27.963511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:27.964115 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:27.965440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:27.966066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:28.019412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:28.028430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:28.028430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:28.028430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:28.028430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:28.028829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:28.098898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:28.108249 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-34a6444d-2cad-4a54-9022-8fd8a1c75ceb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1270 microversion: 2.1 time: 0.092326 Nov 03 02:05:28.109142 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 356/694] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:28 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:28.130995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:28.138745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-66d35a6e-b275-4b8b-8c0e-04efc5ae43a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1509 microversion: 2.1 time: 0.186202 Nov 03 02:05:28.139313 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 339/695] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:27 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:28.485914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:28.486903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:28.493178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:28.493713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:28.494569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:28.495018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:28.527594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-299efd5c-4ef7-4067-9a0f-7109db9b0304 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Nov 03 02:05:28.528157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 357/696] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:28 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:29.124476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:29.125130 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:29.132991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:29.132991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:29.132991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:29.133276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:29.157656 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:29.158471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:29.164139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:29.164579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:29.165347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:29.165776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:29.621421 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:29.628540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c01ee015-09f0-49cd-ab94-0bf3645a043e tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.507699 Nov 03 02:05:29.630351 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 340/697] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:29 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:29.639020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:29.639020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:29.640832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:29.641283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:29.642060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:29.642517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:29.654675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:29.662893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e9a16b11-7d7b-48da-b2c3-ee24e0682b38 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1509 microversion: 2.1 time: 0.508819 Nov 03 02:05:29.674478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 358/698] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:29 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:29.680553 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-83ee222f-e4f2-4691-a3cb-a9e67ffa79d7 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050243 Nov 03 02:05:29.681116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 341/699] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:29 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:30.324165 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-5046f189-6088-4ee8-99ea-0a5dc3b65981 req-5f0db2a1-9089-49fb-8596-d9e7468bcf42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711d09e1-216a-4ba3-9cfc-f5d9f32091ac", "tag": "3d2eb15b-c272-482b-a03e-7d62ece59535"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:30.326037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:30.326037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:05:30.334049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-5046f189-6088-4ee8-99ea-0a5dc3b65981 req-5f0db2a1-9089-49fb-8596-d9e7468bcf42 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:30.335535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-5046f189-6088-4ee8-99ea-0a5dc3b65981 req-5f0db2a1-9089-49fb-8596-d9e7468bcf42 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:30.347582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-5046f189-6088-4ee8-99ea-0a5dc3b65981 req-5f0db2a1-9089-49fb-8596-d9e7468bcf42 service nova] Creating event network-changed:3d2eb15b-c272-482b-a03e-7d62ece59535 for instance 711d09e1-216a-4ba3-9cfc-f5d9f32091ac on hv-cinder-81561 Nov 03 02:05:30.352685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-5046f189-6088-4ee8-99ea-0a5dc3b65981 req-5f0db2a1-9089-49fb-8596-d9e7468bcf42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Nov 03 02:05:30.354444 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 359/700] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:30.647678 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:30.649269 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:30.658417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:30.658927 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:30.659981 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:30.660626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:30.682829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:30.684356 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:30.695482 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:30.695937 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:30.696724 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:30.697282 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:30.964045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:30.979127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b124d968-76da-4eb2-bc5f-30c4730a51f0 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.335457 Nov 03 02:05:30.981486 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 342/701] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:30 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:30.991037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:30.994614 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:31.004009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:31.004828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:31.006760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:31.007449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:31.034845 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:31.051931 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e45d6168-9166-44f4-8207-d01fabcae174 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068061 Nov 03 02:05:31.052914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 343/702] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:30 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:31.059035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b9690a12-2574-4e53-ac85-cb7470e7686d tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1509 microversion: 2.1 time: 0.380663 Nov 03 02:05:31.060134 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-d8ad5a78-dd58-4764-9e37-17467e95d7b2 req-e1c1d5f6-7710-48d3-8a4a-d4bced381d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a688c2f-9028-4f08-8542-7b09dad06fa2", "name": "network-vif-deleted", "tag": "1efa8020-26b3-4ca8-a452-4afc4f914e61"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:31.062172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:31.062172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:31.062801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 360/703] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:30 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:31.070367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d8ad5a78-dd58-4764-9e37-17467e95d7b2 req-e1c1d5f6-7710-48d3-8a4a-d4bced381d02 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:31.071072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-d8ad5a78-dd58-4764-9e37-17467e95d7b2 req-e1c1d5f6-7710-48d3-8a4a-d4bced381d02 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:31.083400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-d8ad5a78-dd58-4764-9e37-17467e95d7b2 req-e1c1d5f6-7710-48d3-8a4a-d4bced381d02 service nova] Creating event network-vif-deleted:1efa8020-26b3-4ca8-a452-4afc4f914e61 for instance 0a688c2f-9028-4f08-8542-7b09dad06fa2 on hv-cinder-81561 Nov 03 02:05:31.089300 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-d8ad5a78-dd58-4764-9e37-17467e95d7b2 req-e1c1d5f6-7710-48d3-8a4a-d4bced381d02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Nov 03 02:05:31.093535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 344/704] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:31.996730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:31.997803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:32.005795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.006267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.007196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.007624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.066023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:32.067324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:32.076046 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.076584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.077353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.077754 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.117425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ecff2965-12c0-4b54-bf2a-5f797fcf9d01 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056018 Nov 03 02:05:32.117995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 345/705] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:32 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:32.122752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:32.123353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:32.130584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.130934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.131729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.132161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.151976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:32.159513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b632f29b-4253-43a8-9db9-207dc481baab tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.166616 Nov 03 02:05:32.160244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 361/706] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:31 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:32.168303 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.168747 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.169190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lazy-loading 'fault' on Instance uuid 0a688c2f-9028-4f08-8542-7b09dad06fa2 {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:05:32.215719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:32.223152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3cb44d75-9426-449b-8561-107ff3c2d517 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 200 len: 1312 microversion: 2.1 time: 0.104176 Nov 03 02:05:32.223716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 346/707] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:32 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:32.643039 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:32.643829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:32.649802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.650268 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.651052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:32.651487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:32.790778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:32.799627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ade16839-e2c7-4820-8809-d50904acf7d2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1593 microversion: 2.1 time: 0.160072 Nov 03 02:05:32.800459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 362/708] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:32 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:33.129338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:33.130356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:33.137299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.137784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.138623 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.139058 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.167836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f7a02aeb-a357-41e8-a5de-6c7a9faae67f tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042142 Nov 03 02:05:33.168418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 347/709] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:05:33 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:05:33.182460 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:33.183823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:33.190087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.190629 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.191614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.192315 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.241085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:33.241979 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: 0a688c2f-9028-4f08-8542-7b09dad06fa2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:33.249134 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.249819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.251799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.251799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.267733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] HTTP exception thrown: Instance 0a688c2f-9028-4f08-8542-7b09dad06fa2 could not be found. Nov 03 02:05:33.268555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Returning 404 to user: Instance 0a688c2f-9028-4f08-8542-7b09dad06fa2 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:05:33.269548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cecf84c9-c50a-4418-834f-d16227122e81 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2" status: 404 len: 111 microversion: 2.1 time: 0.032654 Nov 03 02:05:33.270716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 348/710] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:33 2021] GET /compute/v2.1/servers/0a688c2f-9028-4f08-8542-7b09dad06fa2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 02:05:33.280528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:33.281307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:33.288748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.289487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.290531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.291120 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.324636 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:05:33.366334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:33.374178 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3dabacee-08a2-45df-b193-0408857085f7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.195283 Nov 03 02:05:33.374746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 363/711] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:33 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:33.379419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1586425502", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "networks": [{"uuid": "b9f1ba25-c9df-4fb7-a2b7-25e385903abb"}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:33.430116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] validate_networks() for [('b9f1ba25-c9df-4fb7-a2b7-25e385903abb', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:05:33.836585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:05:33.837015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:05:33.837476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:05:33.837873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:05:33.838306 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:05:33.847684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.848122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.848916 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:33.849494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:33.869412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:05:33.874235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Getting quotas for user c920199e7537410989d8118aecfeb6d9 and project a236a1ddacc947d0a25090b1c2ef1456. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:05:33.885466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:05:33.888533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:05:34.122336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dda49743-9451-4fdc-b320-b791a46fd98c tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 204 len: 0 microversion: 2.1 time: 0.845423 Nov 03 02:05:34.125534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 349/712] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:05:33 2021] DELETE /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:05:34.132567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:34.133403 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:34.140396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:34.140848 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:34.141676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:34.142111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:34.284131 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:34.291303 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5103dc5c-ab50-4ae5-b6be-94552e49a5b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.162714 Nov 03 02:05:34.291866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 350/713] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:34 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:34.330390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-130143c0-2d0a-4870-95e9-717fbdd3bbe3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954372 Nov 03 02:05:34.331629 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 364/714] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:05:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:05:34.344022 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bc428737-dee4-493e-92b4-8a6b8616fa66 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:34.345187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bc428737-dee4-493e-92b4-8a6b8616fa66 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:34.390814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:34.391430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:34.402100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:34.402100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:34.402100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:34.402100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:34.419756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bc428737-dee4-493e-92b4-8a6b8616fa66 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:34.427365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bc428737-dee4-493e-92b4-8a6b8616fa66 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1218 microversion: 2.1 time: 0.088608 Nov 03 02:05:34.428287 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 351/715] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:34 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:34.556586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:34.564213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f3d9c36c-4501-4d96-ba44-6ba0879bb864 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.177080 Nov 03 02:05:34.564864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 365/716] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:34 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:35.307634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:35.308745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:35.315858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.316491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.317274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.317710 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.364590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-cfb75473-7a97-4655-93d7-2c335b5073f6 req-262da9ad-ebe5-48c6-b9a2-4a193a80fb00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:35.366193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:35.366193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:05:35.376658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-cfb75473-7a97-4655-93d7-2c335b5073f6 req-262da9ad-ebe5-48c6-b9a2-4a193a80fb00 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.377934 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-cfb75473-7a97-4655-93d7-2c335b5073f6 req-262da9ad-ebe5-48c6-b9a2-4a193a80fb00 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.392129 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-cfb75473-7a97-4655-93d7-2c335b5073f6 req-262da9ad-ebe5-48c6-b9a2-4a193a80fb00 service nova] Creating event network-changed:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:05:35.398448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-cfb75473-7a97-4655-93d7-2c335b5073f6 req-262da9ad-ebe5-48c6-b9a2-4a193a80fb00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037584 Nov 03 02:05:35.399418 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 366/717] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:05:35.445516 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:35.446335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:35.454417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.459770 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.459770 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.459770 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.555441 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:35.556639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:35.571488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-da5b5dd5-10b3-433e-9313-2e46071919ff tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.267482 Nov 03 02:05:35.578469 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7d23ad75-bdfd-4329-b6d8-4a3ac556f3b8 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1222 microversion: 2.1 time: 0.137103 Nov 03 02:05:35.579067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 367/718] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:35 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:35.583595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:35.584380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:35.588372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 352/719] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:35 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:35.590462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.590910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.591689 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:35.592117 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:35.851279 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:35.859883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2c6a56c9-f142-45ca-a8bd-4c1c88c3f89c tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.279660 Nov 03 02:05:35.860711 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 368/720] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:35 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:36.402694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-f0653301-6704-4982-93f6-078308385c99 req-e027c98b-6b1f-4bb2-b2cf-c306ec360132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711d09e1-216a-4ba3-9cfc-f5d9f32091ac", "name": "network-vif-plugged", "status": "completed", "tag": "3d2eb15b-c272-482b-a03e-7d62ece59535"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:36.404400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:36.404400 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:36.411788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f0653301-6704-4982-93f6-078308385c99 req-e027c98b-6b1f-4bb2-b2cf-c306ec360132 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.412229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f0653301-6704-4982-93f6-078308385c99 req-e027c98b-6b1f-4bb2-b2cf-c306ec360132 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:36.427240 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-f0653301-6704-4982-93f6-078308385c99 req-e027c98b-6b1f-4bb2-b2cf-c306ec360132 service nova] Creating event network-vif-plugged:3d2eb15b-c272-482b-a03e-7d62ece59535 for instance 711d09e1-216a-4ba3-9cfc-f5d9f32091ac on hv-cinder-81561 Nov 03 02:05:36.432124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-f0653301-6704-4982-93f6-078308385c99 req-e027c98b-6b1f-4bb2-b2cf-c306ec360132 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034494 Nov 03 02:05:36.432728 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 353/721] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:36.595298 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:36.595894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:36.598055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:36.598856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:36.605929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.606416 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:36.608122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.608755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:36.609646 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.610193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:36.610464 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.610866 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:36.714152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:36.723136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1ea16d64-6138-4610-bc9f-4070eecc7003 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1270 microversion: 2.1 time: 0.131475 Nov 03 02:05:36.734128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 354/722] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:36 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:36.787385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:36.796113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b3b40343-ca80-4a46-968a-8c6c4d0640a4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.204855 Nov 03 02:05:36.796780 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 369/723] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:36 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:36.877303 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:36.878034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:36.886930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.889006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:36.889006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:36.889006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:37.059247 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:37.066737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-44aee66a-df9c-44ac-9f62-3e078fd34efb tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.193773 Nov 03 02:05:37.067301 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 355/724] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:36 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:37.741324 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:37.742019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:37.748886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:37.749414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:37.750551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:37.751492 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:37.813239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:37.813845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:37.820154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:37.820602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:37.821364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:37.821790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:37.830832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:37.840840 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e4f4f876-bd9c-4760-8fca-f9285f28a5ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1276 microversion: 2.1 time: 0.102754 Nov 03 02:05:37.842789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 370/725] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:37 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:38.068233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:38.078671 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-762d22d5-06e7-430c-a0f2-45c0b7086530 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.269074 Nov 03 02:05:38.085638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 356/726] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:37 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:38.089869 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:38.090775 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:38.096706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:38.097919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:38.098722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:38.099231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:38.303829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:38.316526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-71a81425-80e6-4be5-89c5-c6ff82361dd2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1318 microversion: 2.1 time: 0.230603 Nov 03 02:05:38.317934 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 371/727] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:38 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:38.430308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-89052705"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:38.431049 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:38.438685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:38.439535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:38.440508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:38.441118 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:38.722365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.network.security_group_api [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Adding security group 7d974952-521b-4022-8994-617d7852a30a to port 96d79956-425a-4084-b4ad-7e4e29f76595 Nov 03 02:05:38.859758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:38.860360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:38.866940 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:38.867438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:38.868446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:38.868878 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.188719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:39.196233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9c0818b2-6ac9-47c6-958f-4832c7251585 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.340131 Nov 03 02:05:39.196808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 372/728] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:38 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:39.201159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:39.201773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:39.207337 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.207778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.208567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.209003 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.486767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-02e5a8f7-13f2-424d-a38b-0c8048f3cdfb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/action" status: 202 len: 0 microversion: 2.1 time: 1.060224 Nov 03 02:05:39.492739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 357/729] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:05:38 2021] POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:05:39.498788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:39.500230 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:39.506805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.507558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.508725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.509985 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.526872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:39.541485 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-55fbf207-16b2-480f-9b09-5ca9438c5af0 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.343547 Nov 03 02:05:39.546752 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 373/730] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:39 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:39.551360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:39.554328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:39.567912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.568359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.572695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.573144 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.803991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:39.813171 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9cb92e3a-5f81-4ebb-810e-a10884b59779 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1504 microversion: 2.1 time: 0.318648 Nov 03 02:05:39.813821 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 358/731] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:39 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:39.818835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-cc80e9b7-f2d4-466a-8ca7-e48154677c71 req-241d9a57-e831-497b-ac89-85b29bdc16cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:39.820915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:39.820915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:39.825317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:39.833858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-cc80e9b7-f2d4-466a-8ca7-e48154677c71 req-241d9a57-e831-497b-ac89-85b29bdc16cc service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.834946 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-cc80e9b7-f2d4-466a-8ca7-e48154677c71 req-241d9a57-e831-497b-ac89-85b29bdc16cc service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.835434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-01f13183-90a3-4731-8480-dfee642bbb64 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1757 microversion: 2.1 time: 0.287461 Nov 03 02:05:39.850170 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 374/732] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:39 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1757 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:39.850170 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50fdb18d-35ea-43f7-bf07-55b4b3aeb413", "device": "/dev/sdb"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:39.850170 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:39.852080 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.852718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.853745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:39.856911 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:39.878744 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-cc80e9b7-f2d4-466a-8ca7-e48154677c71 req-241d9a57-e831-497b-ac89-85b29bdc16cc service nova] Creating event network-changed:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:05:39.886925 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-cc80e9b7-f2d4-466a-8ca7-e48154677c71 req-241d9a57-e831-497b-ac89-85b29bdc16cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070833 Nov 03 02:05:39.887038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 359/733] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:40.213062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:40.213780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:40.220024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:40.220877 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:40.221858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:40.222521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:40.469530 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:40.476995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8eb5e566-ff62-4c12-b15e-9e8866069031 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.267945 Nov 03 02:05:40.486349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 360/734] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:40 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:40.559561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:40.560440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:40.567579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:40.568046 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:40.568870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:40.569302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:40.702604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:40.709805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4d8b464b-a3fe-448d-a38d-a736299af6b5 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.154398 Nov 03 02:05:40.710399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 361/735] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:40 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:40.727543 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6beabc2e-6d0b-44c2-ab58-8a609de47b82 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "POST /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888551 Nov 03 02:05:40.728193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 375/736] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:05:39 2021] POST /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:41.493504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:41.494113 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:41.500373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:41.500835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:41.501593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:41.502026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:41.631170 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:41.638812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3b7c44d3-7dc8-45a4-85e3-9bd89ac96f61 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.148978 Nov 03 02:05:41.639370 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 362/737] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:41 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:41.727555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:41.728245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:41.734494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:41.734943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:41.735712 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:41.736141 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:41.868075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:41.875279 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-95c488d1-e4be-4c34-9eaa-47bab1b1af53 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.152170 Nov 03 02:05:41.875844 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 376/738] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:41 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:41.907216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-69ee41db-527d-43dc-a108-ebc77c783e3a req-2353bc3a-4d62-4200-b2e4-678e8cf1ce85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5ec1d9-6496-4b0d-8c10-6506ec67049e", "tag": "51737622-94ed-4ac8-9a34-b97530c518a0"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:41.908794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:41.908794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:41.915445 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-69ee41db-527d-43dc-a108-ebc77c783e3a req-2353bc3a-4d62-4200-b2e4-678e8cf1ce85 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:41.915886 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-69ee41db-527d-43dc-a108-ebc77c783e3a req-2353bc3a-4d62-4200-b2e4-678e8cf1ce85 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:41.926059 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-69ee41db-527d-43dc-a108-ebc77c783e3a req-2353bc3a-4d62-4200-b2e4-678e8cf1ce85 service nova] Creating event network-changed:51737622-94ed-4ac8-9a34-b97530c518a0 for instance bd5ec1d9-6496-4b0d-8c10-6506ec67049e on hv-cinder-81561 Nov 03 02:05:41.930640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-69ee41db-527d-43dc-a108-ebc77c783e3a req-2353bc3a-4d62-4200-b2e4-678e8cf1ce85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027524 Nov 03 02:05:41.931198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 363/739] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:42.662286 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:42.663048 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:42.669557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:42.669998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:42.672658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:42.672658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:42.896722 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:42.898354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:42.907192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:42.907777 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:42.908634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:42.909139 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:43.122215 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:43.129462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d6c0e1b9-e0b4-4e01-8799-f74219633a6e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.471111 Nov 03 02:05:43.130038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 377/740] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:42 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:43.222219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:43.229396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bfd4e26e-7e42-427e-8b0e-852d5593418f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1522 microversion: 2.1 time: 0.340183 Nov 03 02:05:43.230069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 364/741] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:42 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:43.945386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-d675def8-39cc-4f02-ad3c-fb9c334cc5a9 req-d738d45c-b5af-4fbd-af92-3942bef9d93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6fe0cb-1e19-4f19-84b4-15e0d56010fe", "name": "network-vif-deleted", "tag": "c800a63f-5d20-4479-bff0-75fde1f2c55a"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:43.946982 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:43.946982 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:05:43.954083 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-d675def8-39cc-4f02-ad3c-fb9c334cc5a9 req-d738d45c-b5af-4fbd-af92-3942bef9d93e service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:43.954550 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-d675def8-39cc-4f02-ad3c-fb9c334cc5a9 req-d738d45c-b5af-4fbd-af92-3942bef9d93e service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:43.964846 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-d675def8-39cc-4f02-ad3c-fb9c334cc5a9 req-d738d45c-b5af-4fbd-af92-3942bef9d93e service nova] Creating event network-vif-deleted:c800a63f-5d20-4479-bff0-75fde1f2c55a for instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe on hv-cinder-81561 Nov 03 02:05:43.969447 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-d675def8-39cc-4f02-ad3c-fb9c334cc5a9 req-d738d45c-b5af-4fbd-af92-3942bef9d93e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027783 Nov 03 02:05:43.970015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 378/742] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:05:44.145782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:44.146417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:44.152613 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:44.153059 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:44.153837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:44.154301 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:44.246923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:44.247717 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:44.253813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:44.254365 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:44.255210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:44.255750 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:44.286913 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:44.287490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:44.288127 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lazy-loading 'fault' on Instance uuid fe6fe0cb-1e19-4f19-84b4-15e0d56010fe {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:05:44.295147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:44.302750 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-55042886-9b4f-41f1-bd2b-f9b03b9dcc03 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.160654 Nov 03 02:05:44.313199 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 365/743] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:44 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:44.328295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a67d6b33834ba6b498e76c41abed93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf02d32d2b4466f90bc61e38f1776a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:44.335608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5c361577-0eab-4c13-a32f-76b5cad703e4 tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 200 len: 1312 microversion: 2.1 time: 0.093078 Nov 03 02:05:44.336186 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 379/744] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:44 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:45.319457 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:45.320055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:45.327032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:45.327479 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:45.328270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:45.328705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:45.356779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:45.356779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] [instance: fe6fe0cb-1e19-4f19-84b4-15e0d56010fe] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:45.362125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:45.362612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:45.363412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:45.363852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:45.378740 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] HTTP exception thrown: Instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe could not be found. Nov 03 02:05:45.379379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] Returning 404 to user: Instance fe6fe0cb-1e19-4f19-84b4-15e0d56010fe could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:05:45.380193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bbc8665a-c597-43f0-a677-aefc311e839f tempest-ServerRescueNegativeTestJSON-1530572445 tempest-ServerRescueNegativeTestJSON-1530572445-project] 10.222.0.30 "GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe" status: 404 len: 111 microversion: 2.1 time: 0.029370 Nov 03 02:05:45.380812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 380/745] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:45 2021] GET /compute/v2.1/servers/fe6fe0cb-1e19-4f19-84b4-15e0d56010fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:05:45.459709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:45.466876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1c044526-a316-4105-87df-075e2a2e3354 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.151026 Nov 03 02:05:45.467451 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 366/746] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:45 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:46.195748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1695756831", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1404425520", "security_groups": [{"name": "tempest-secgroup-smoke-942012747"}], "networks": [{"uuid": "85bfa113-6079-42d9-9c6f-8ca12bd1c59a"}], "block_device_mapping_v2": [{"uuid": "6db88752-0231-48a4-a934-92732605f107", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:46.309678 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] validate_networks() for [('85bfa113-6079-42d9-9c6f-8ca12bd1c59a', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:05:46.391429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-f37f5431-82bf-4903-a43a-8bc0a07d418e req-0debf980-aa67-428e-bc53-03cf6c346356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5ec1d9-6496-4b0d-8c10-6506ec67049e", "name": "network-vif-plugged", "status": "completed", "tag": "51737622-94ed-4ac8-9a34-b97530c518a0"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:46.393480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:46.393480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:05:46.401998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f37f5431-82bf-4903-a43a-8bc0a07d418e req-0debf980-aa67-428e-bc53-03cf6c346356 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:46.403270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f37f5431-82bf-4903-a43a-8bc0a07d418e req-0debf980-aa67-428e-bc53-03cf6c346356 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:46.414898 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-f37f5431-82bf-4903-a43a-8bc0a07d418e req-0debf980-aa67-428e-bc53-03cf6c346356 service nova] Creating event network-vif-plugged:51737622-94ed-4ac8-9a34-b97530c518a0 for instance bd5ec1d9-6496-4b0d-8c10-6506ec67049e on hv-cinder-81561 Nov 03 02:05:46.420494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-f37f5431-82bf-4903-a43a-8bc0a07d418e req-0debf980-aa67-428e-bc53-03cf6c346356 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036003 Nov 03 02:05:46.422414 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 367/747] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:46.494075 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:46.497724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:46.510828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:46.517243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:46.519514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:46.519514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:46.768809 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:46.785263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e9135d53-d253-459b-83b4-c426bad2877d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.305498 Nov 03 02:05:46.786182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 368/748] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:46 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:46.796513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:05:46.797017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:05:46.797604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:05:46.798595 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:05:46.798851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:05:46.808460 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:46.809191 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:46.809991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:46.810449 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:46.826294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Getting quotas for project 136f0a28eb6d4e108836305888f1fcb4. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:05:46.830106 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Getting quotas for user 77f07b2b1d72456fb282fd434d73e946 and project 136f0a28eb6d4e108836305888f1fcb4. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:05:46.888046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:05:46.890335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6db88752-0231-48a4-a934-92732605f107',volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:05:47.584124 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d4704aea-57c5-48e6-abfb-929a660195d8 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.391867 Nov 03 02:05:47.585131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 381/749] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:05:46 2021] POST /compute/v2.1/servers => generated 405 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 02:05:47.594928 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d1217bd0-fcd7-4c5a-b828-af85f4f69b5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:47.595985 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d1217bd0-fcd7-4c5a-b828-af85f4f69b5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:47.691239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d1217bd0-fcd7-4c5a-b828-af85f4f69b5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:47.697831 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d1217bd0-fcd7-4c5a-b828-af85f4f69b5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1089 microversion: 2.1 time: 0.106532 Nov 03 02:05:47.699386 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 369/750] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:47 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1089 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:47.802876 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:47.803478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:47.809875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:47.810349 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:47.811371 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:47.811805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:47.940446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:47.947997 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-237d59d7-f110-4ea9-bfd2-cf26f3dd1652 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1318 microversion: 2.1 time: 0.148867 Nov 03 02:05:47.948710 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 382/751] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:47 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:48.719824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7cdadf59-9cce-49a7-944b-0a0e6e6eb961 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:48.720448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7cdadf59-9cce-49a7-944b-0a0e6e6eb961 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:48.781403 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7cdadf59-9cce-49a7-944b-0a0e6e6eb961 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:48.788685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7cdadf59-9cce-49a7-944b-0a0e6e6eb961 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1089 microversion: 2.1 time: 0.077124 Nov 03 02:05:48.789256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 370/752] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:48 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:05:48.964896 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:48.965912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:48.972333 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:48.973012 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:48.973796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:48.974265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:49.119307 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:49.127294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cfbcf61c-c43e-40ac-a1e6-3df58f28a2e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1509 microversion: 2.1 time: 0.166219 Nov 03 02:05:49.130555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 383/753] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:48 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:49.805198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:49.805891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:49.817358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:49.817358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:49.817358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:49.817805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:49.881037 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:49.888446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-98cb1d26-b44e-4ef2-ac74-7224a6dd941a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1187 microversion: 2.1 time: 0.087055 Nov 03 02:05:49.889014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 371/754] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:49 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:50.905007 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:50.905609 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:50.911775 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:50.912222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:50.912994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:50.913426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:50.972516 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:50.980007 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-034e3245-24ac-4060-bf60-01a9d4678cfc tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1195 microversion: 2.1 time: 0.079113 Nov 03 02:05:50.980512 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 384/755] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:50 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1195 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:52.002601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:52.002601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:52.003422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:52.003868 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:52.004719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:52.005154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:52.068411 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:52.076675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-69723f48-bb25-475a-925e-e4c4a2877d6a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1195 microversion: 2.1 time: 0.083757 Nov 03 02:05:52.077678 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 372/756] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:51 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1195 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:53.092218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:53.092829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:53.099091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:53.099530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:53.100302 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:53.100735 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:53.160222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:53.167759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-599899cb-b76c-43ee-89df-df4abd2eeca3 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1195 microversion: 2.1 time: 0.079186 Nov 03 02:05:53.168824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 385/757] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:53 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1195 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:54.189945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:54.192633 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:54.200934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:54.201454 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:54.202446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:54.203125 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:54.396582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5c8cafe3-9221-4e73-969a-4954b931e32b tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7d5d5e0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:54.416102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:54.427213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c3bcb331-dfaa-430f-9ea6-acfca2e20254 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1272 microversion: 2.1 time: 0.244309 Nov 03 02:05:54.427941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 373/758] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:54 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:54.451895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7087da88-4281-4fd3-b714-79dc5da138f1"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:54.451895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:54.458579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:54.459360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:54.460764 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:54.461286 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:54.511036 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5c8cafe3-9221-4e73-969a-4954b931e32b tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/43343c0f-fdbc-486f-861e-45f335686851" status: 200 len: 351 microversion: 2.1 time: 0.121808 Nov 03 02:05:54.515107 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 386/759] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:05:54 2021] GET /compute/v2.1/os-volumes/43343c0f-fdbc-486f-861e-45f335686851 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:55.242214 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-6d94d2de-4217-4633-9aa0-158d4da8bcfd req-285cc2be-6afa-4ede-9e1b-7868e343c248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:05:55.244078 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:05:55.244078 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:05:55.253936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-6d94d2de-4217-4633-9aa0-158d4da8bcfd req-285cc2be-6afa-4ede-9e1b-7868e343c248 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:55.254417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-6d94d2de-4217-4633-9aa0-158d4da8bcfd req-285cc2be-6afa-4ede-9e1b-7868e343c248 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:55.260213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a1bb52a4-f3d8-42c1-af21-55f71752e1e6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "POST /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816381 Nov 03 02:05:55.261513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 374/760] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:05:54 2021] POST /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:55.266663 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-6d94d2de-4217-4633-9aa0-158d4da8bcfd req-285cc2be-6afa-4ede-9e1b-7868e343c248 service nova] Creating event network-changed:9fede95c-7a4c-431b-802a-bfb045b4ba84 for instance bfcedc8e-ab45-4300-9e60-6e82319256b8 on hv-cinder-81561 Nov 03 02:05:55.277527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-6d94d2de-4217-4633-9aa0-158d4da8bcfd req-285cc2be-6afa-4ede-9e1b-7868e343c248 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039018 Nov 03 02:05:55.278266 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 387/761] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:55.445113 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:55.445897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:55.451888 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:55.452332 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:55.453087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:55.453546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:55.587214 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:55.594846 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-86abafbe-b5b0-4ab4-b04b-9b0668c4f1a5 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1272 microversion: 2.1 time: 0.153733 Nov 03 02:05:55.595399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 375/762] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:55 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:56.612317 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:56.613006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:56.619413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:56.619852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:56.620607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:56.621663 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:56.751632 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:56.759011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c219523f-7eab-4011-a3b0-db5fea206ec2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1272 microversion: 2.1 time: 0.150679 Nov 03 02:05:56.759565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 388/763] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:56 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:57.775823 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:57.776628 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:57.782835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:57.783290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:57.815201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:57.815201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:57.979625 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:57.990863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ab4a7123-b38e-4bd1-8f05-461277c0cc5a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1272 microversion: 2.1 time: 0.217743 Nov 03 02:05:57.991684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 376/764] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:57 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:58.294648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c061c136-ba17-4abe-9289-ef783d0cd2d2 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7d5df70>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:58.341452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c061c136-ba17-4abe-9289-ef783d0cd2d2 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8163914b-750f-4c46-bbb1-6c629bbeee80" status: 200 len: 351 microversion: 2.1 time: 0.051087 Nov 03 02:05:58.342028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 389/765] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:05:58 2021] GET /compute/v2.1/os-volumes/8163914b-750f-4c46-bbb1-6c629bbeee80 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:05:59.008658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:05:59.009345 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:05:59.016234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:59.016753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:59.017621 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:05:59.018127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:05:59.157406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:05:59.164800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e6d66859-b910-4514-9222-df87b8a0059d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.159942 Nov 03 02:05:59.165374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 377/766] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:05:59 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:05:59.970719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d6e404b5-596f-43c2-8e3b-257d71215d42 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7bccaf0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.014793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d6e404b5-596f-43c2-8e3b-257d71215d42 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2dff10a6-18ed-4b95-a5e9-646f635576b1" status: 200 len: 351 microversion: 2.1 time: 0.047979 Nov 03 02:06:00.015366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 390/767] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Nov 3 02:05:59 2021] GET /compute/v2.1/os-volumes/2dff10a6-18ed-4b95-a5e9-646f635576b1 => generated 351 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:00.026053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8ab31e8f-30e2-4a2c-acb9-62e31fbd9adc tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30c45ad8b0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.105156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8ab31e8f-30e2-4a2c-acb9-62e31fbd9adc tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082670 Nov 03 02:06:00.106382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 378/768] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:00.118035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d5709e25-899d-44ce-b057-54ea7cb907d7 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7be61f0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.181556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.182234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:00.188595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:00.189189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:00.190020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:00.190539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:00.198163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d5709e25-899d-44ce-b057-54ea7cb907d7 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083619 Nov 03 02:06:00.198748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 391/769] 10.222.0.30 () {58 vars in 1148 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:00.210163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-382560e9-7d27-4ca6-87b5-151bcee4481f tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30c408f670>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.291931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-382560e9-7d27-4ca6-87b5-151bcee4481f tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085053 Nov 03 02:06:00.292531 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 392/770] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:00.303736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2b943856-06de-4d85-95a3-256d8d5fe392 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7d09430>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.330951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:00.338307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6b2d7d44-d816-4d19-9006-6759664ffcaa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.160392 Nov 03 02:06:00.338869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 379/771] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:00.380842 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2b943856-06de-4d85-95a3-256d8d5fe392 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.080548 Nov 03 02:06:00.381443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 393/772] 10.222.0.30 () {58 vars in 1166 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:06:00.393228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-38ff0264-213b-46fb-9072-97212075f73e tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30c44d1160>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.471179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-38ff0264-213b-46fb-9072-97212075f73e tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081468 Nov 03 02:06:00.471833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 380/773] 10.222.0.30 () {58 vars in 1169 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:00.483833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1fdc3747-b9e0-44fe-b03d-43c1ad9838dc tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7be68b0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.563719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1fdc3747-b9e0-44fe-b03d-43c1ad9838dc tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083519 Nov 03 02:06:00.564310 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 394/774] 10.222.0.30 () {58 vars in 1154 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:00.575527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8fd8fd85-50f3-469a-9ded-6410dec96b65 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30c458af70>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.652863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8fd8fd85-50f3-469a-9ded-6410dec96b65 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081276 Nov 03 02:06:00.653426 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 381/775] 10.222.0.30 () {58 vars in 1187 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:00.664376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-18099056-81d7-4407-a66f-9d6c12cd7371 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] Calling method '.version_select at 0x7f30b7be6dc0>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:00.743832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-18099056-81d7-4407-a66f-9d6c12cd7371 tempest-VolumesTestJSON-789597081 tempest-VolumesTestJSON-789597081-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082197 Nov 03 02:06:00.743832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 395/776] 10.222.0.30 () {58 vars in 1154 bytes} [Wed Nov 3 02:06:00 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:01.355980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:01.356695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:01.363428 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:01.363996 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:01.364839 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:01.365280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:01.501395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:01.508840 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-56fb8140-5f1a-471f-8f95-4ca940686bed tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.156917 Nov 03 02:06:01.509336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 382/777] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:01 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:02.304276 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:02.304782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:02.310487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:02.311187 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:02.311949 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:02.312379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:02.387823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lazy-loading 'services' on Instance uuid 711d09e1-216a-4ba3-9cfc-f5d9f32091ac {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:02.525408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:02.526008 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:02.532738 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:02.533174 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:02.533928 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:02.534378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:02.588625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-21a5053e-4bb8-431a-9dd5-f085e66a6ba7 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac/os-volume_attachments/50fdb18d-35ea-43f7-bf07-55b4b3aeb413" status: 202 len: 0 microversion: 2.1 time: 0.288328 Nov 03 02:06:02.589452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 396/778] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:06:02 2021] DELETE /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac/os-volume_attachments/50fdb18d-35ea-43f7-bf07-55b4b3aeb413 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:06:02.667854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:02.675191 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-23112224-f5b2-4061-97d4-73c1142a529a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.153421 Nov 03 02:06:02.675751 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 383/779] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:02 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:03.692450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:03.695393 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:03.699546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:03.699999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:03.700793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:03.701211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:03.915803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:03.923555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2ff8c91d-7df1-434d-b5f8-dc181a1dd294 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.235039 Nov 03 02:06:03.924240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 397/780] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:03 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:04.940435 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:04.941093 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:04.948142 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:04.949874 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:04.950183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:04.950615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:05.112808 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:05.120175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-39224141-f62f-4811-9190-77fc8dc2d912 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.183445 Nov 03 02:06:05.124213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 384/781] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:04 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:06.140916 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:06.141526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:06.149788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.149788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.154725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.154725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.294971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:06.295507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:06.300438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:06.301555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.302001 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.302836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.303245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.308046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2a3162e2-895e-491d-950e-430f8bb6b4c0 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.171238 Nov 03 02:06:06.309599 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 398/782] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:06 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:06.381626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lazy-loading 'services' on Instance uuid bd5ec1d9-6496-4b0d-8c10-6506ec67049e {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:06.634857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-10c04542-2890-460e-be48-af5f2fea5142 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments/7087da88-4281-4fd3-b714-79dc5da138f1" status: 202 len: 0 microversion: 2.1 time: 0.343294 Nov 03 02:06:06.635446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 385/783] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:06:06 2021] DELETE /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments/7087da88-4281-4fd3-b714-79dc5da138f1 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:06:06.643713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:06.650773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:06.656673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.657094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.657867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.658344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.689245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4a1a75f1-4f70-42a3-a99c-9be65d9e7874 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049212 Nov 03 02:06:06.689968 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 399/784] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:06:06 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:06.874284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:06.875160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:06.881946 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.882525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.883370 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:06.884028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:06.909860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:06:07.323260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c350d908-c7c3-4d2b-9fc4-5fff21524309 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "DELETE /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 204 len: 0 microversion: 2.1 time: 0.453754 Nov 03 02:06:07.323963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 386/785] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:06:06 2021] DELETE /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:06:07.326035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:07.326543 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:07.332806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:07.334305 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:07.337828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:07.338330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:07.339262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:07.339716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:07.340859 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:07.341488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:07.342181 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:07.342633 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:07.769675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:07.776954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ac997ddd-cb49-42dc-9b6c-175ee190a328 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.455178 Nov 03 02:06:07.777532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 400/786] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:07 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:07.781399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:07.781832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:07.782769 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:07.788538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:07.788989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:07.789608 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5f2cfcd3-67d6-4e05-94f7-85c63acaa2f2 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1510 microversion: 2.1 time: 0.460899 Nov 03 02:06:07.789744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:07.790201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:07.790366 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 387/787] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:07 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:07.820270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5fe06682-f675-4323-b792-c38691761421 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041653 Nov 03 02:06:07.820746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 401/788] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:06:07 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:08.793994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:08.794628 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:08.800926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:08.801572 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:08.802607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:08.803034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:08.807229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:08.811151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:08.815424 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:08.815950 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:08.817017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:08.817534 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:09.004205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:09.011580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:09.012491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4564572f-9f25-47a8-b803-ba7970bece6e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.221610 Nov 03 02:06:09.013164 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 388/789] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:08 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:09.017755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:09.018930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:09.020478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f6dc1d14-63ab-4785-af3f-452fffdcc886 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1510 microversion: 2.1 time: 0.216958 Nov 03 02:06:09.028569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 402/790] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:08 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:09.028569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-cb97059c-672e-4dbb-b0d3-812e779ed6a2 req-42d9372b-3564-4b7d-a50d-c0a63e275cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "name": "network-vif-plugged", "status": "completed", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:09.028569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:09.028569 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:09.033207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:09.033353 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-cb97059c-672e-4dbb-b0d3-812e779ed6a2 req-42d9372b-3564-4b7d-a50d-c0a63e275cd8 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:09.033677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:09.033790 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-cb97059c-672e-4dbb-b0d3-812e779ed6a2 req-42d9372b-3564-4b7d-a50d-c0a63e275cd8 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:09.034552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:09.034984 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:09.044698 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-cb97059c-672e-4dbb-b0d3-812e779ed6a2 req-42d9372b-3564-4b7d-a50d-c0a63e275cd8 service nova] Creating event network-vif-plugged:9fede95c-7a4c-431b-802a-bfb045b4ba84 for instance bfcedc8e-ab45-4300-9e60-6e82319256b8 on hv-cinder-81561 Nov 03 02:06:09.051025 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-cb97059c-672e-4dbb-b0d3-812e779ed6a2 req-42d9372b-3564-4b7d-a50d-c0a63e275cd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028880 Nov 03 02:06:09.051950 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 403/791] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:09.066029 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0b5d5f0f-c702-499a-a683-3ea78b213808 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051747 Nov 03 02:06:09.066625 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 389/792] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:06:09 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:06:10.030037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:10.031355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:10.036805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:10.037926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:10.039066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.044880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.045002 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.045384 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.045773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.046406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.046920 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.047356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.263300 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:10.270557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:10.272132 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-be27011d-aede-4bf4-8f98-eb18e170bca7 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1260 microversion: 2.1 time: 0.246890 Nov 03 02:06:10.281581 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 404/793] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:10 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:10.289179 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1aced0be-6a65-49d0-8e7c-21cc156fc873 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1510 microversion: 2.1 time: 0.255883 Nov 03 02:06:10.289994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 390/794] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:10 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:10.361009 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-4c719147-f6c8-493e-b813-e8bc08d3c19b req-c792e215-a2d5-4d83-b9e0-a9311bd5b148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711d09e1-216a-4ba3-9cfc-f5d9f32091ac", "name": "network-vif-deleted", "tag": "3d2eb15b-c272-482b-a03e-7d62ece59535"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:10.362805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:10.362805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:10.369631 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-4c719147-f6c8-493e-b813-e8bc08d3c19b req-c792e215-a2d5-4d83-b9e0-a9311bd5b148 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.373915 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-4c719147-f6c8-493e-b813-e8bc08d3c19b req-c792e215-a2d5-4d83-b9e0-a9311bd5b148 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.380656 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-4c719147-f6c8-493e-b813-e8bc08d3c19b req-c792e215-a2d5-4d83-b9e0-a9311bd5b148 service nova] Creating event network-vif-deleted:3d2eb15b-c272-482b-a03e-7d62ece59535 for instance 711d09e1-216a-4ba3-9cfc-f5d9f32091ac on hv-cinder-81561 Nov 03 02:06:10.385984 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-4c719147-f6c8-493e-b813-e8bc08d3c19b req-c792e215-a2d5-4d83-b9e0-a9311bd5b148 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028379 Nov 03 02:06:10.387319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 405/795] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:10.444600 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:10.445095 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:10.451409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.451930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.452841 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.453338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.478872 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:06:10.779541 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-50583e57-2b6e-4247-b939-a50fa9177686 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 204 len: 0 microversion: 2.1 time: 0.338222 Nov 03 02:06:10.780125 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 391/796] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:06:10 2021] DELETE /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:06:10.788997 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:10.789853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:10.796007 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.796450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.797241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:10.797668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:10.930761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:10.938718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-73ed5e6e-7234-4c39-a5ff-238d3abaf7ae tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1515 microversion: 2.1 time: 0.153876 Nov 03 02:06:10.939293 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 406/797] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:10 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:11.290526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:11.291252 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:11.297527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.297976 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.298789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.299219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.309092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:11.309092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:11.314946 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.315492 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.316364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.316999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.353652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.358616 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.359088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lazy-loading 'fault' on Instance uuid 711d09e1-216a-4ba3-9cfc-f5d9f32091ac {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:11.408205 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07503c14bcbe43d292e444271688f56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a980ad0c18487f84e6b1163bde3249', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:11.417113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-88aa8a16-011a-413c-b3bc-0ad1396097ac tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 200 len: 1308 microversion: 2.1 time: 0.114692 Nov 03 02:06:11.417683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 407/798] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:11 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:11.493608 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:11.503469 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3e4dc598-41b9-4031-9fc2-3618bb8e9dec tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1445 microversion: 2.1 time: 0.216847 Nov 03 02:06:11.504368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 392/799] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:11 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1445 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:11.523412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:11.524024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:11.529965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.530440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.531228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.531693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.672480 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:11.674072 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-74ba584d-1da3-4010-bd07-392b5d1e245b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1445 microversion: 2.1 time: 0.154265 Nov 03 02:06:11.674681 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 408/800] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:11 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:11.955416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:11.956043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:11.962611 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.963045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:11.963889 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:11.964320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:12.165919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:12.174467 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a11265d5-2a4f-44fa-ace4-c7094d026905 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1515 microversion: 2.1 time: 0.223197 Nov 03 02:06:12.175040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 393/801] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:11 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:12.435213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:12.436077 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] [instance: 711d09e1-216a-4ba3-9cfc-f5d9f32091ac] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:12.441703 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:12.442159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:12.442939 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:12.443367 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:12.456707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] HTTP exception thrown: Instance 711d09e1-216a-4ba3-9cfc-f5d9f32091ac could not be found. Nov 03 02:06:12.457279 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] Returning 404 to user: Instance 711d09e1-216a-4ba3-9cfc-f5d9f32091ac could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:06:12.458073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-25b735b4-2757-4027-8c6b-af7dac8c40e4 tempest-VolumesSnapshotTestJSON-425463182 tempest-VolumesSnapshotTestJSON-425463182-project] 10.222.0.30 "GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac" status: 404 len: 111 microversion: 2.1 time: 0.026834 Nov 03 02:06:12.458618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 409/802] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:12 2021] GET /compute/v2.1/servers/711d09e1-216a-4ba3-9cfc-f5d9f32091ac => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:06:13.191076 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:13.191938 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:13.198412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:13.198855 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:13.199913 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:13.200169 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:13.442558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:13.457272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dd83afd2-33ea-42f0-8e5b-b3239901a80b tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1515 microversion: 2.1 time: 0.269561 Nov 03 02:06:13.458254 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 394/803] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:13 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:13.487903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-82112f3c-0e19-43bf-b7dd-79f9e18c8c61 req-ccba768c-c41e-49da-a65e-ba9fd6eebee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5ec1d9-6496-4b0d-8c10-6506ec67049e", "name": "network-vif-deleted", "tag": "51737622-94ed-4ac8-9a34-b97530c518a0"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:13.489520 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:13.489520 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:13.497443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-82112f3c-0e19-43bf-b7dd-79f9e18c8c61 req-ccba768c-c41e-49da-a65e-ba9fd6eebee5 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:13.498233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-82112f3c-0e19-43bf-b7dd-79f9e18c8c61 req-ccba768c-c41e-49da-a65e-ba9fd6eebee5 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:13.513236 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-82112f3c-0e19-43bf-b7dd-79f9e18c8c61 req-ccba768c-c41e-49da-a65e-ba9fd6eebee5 service nova] Creating event network-vif-deleted:51737622-94ed-4ac8-9a34-b97530c518a0 for instance bd5ec1d9-6496-4b0d-8c10-6506ec67049e on hv-cinder-81561 Nov 03 02:06:13.518818 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-82112f3c-0e19-43bf-b7dd-79f9e18c8c61 req-ccba768c-c41e-49da-a65e-ba9fd6eebee5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035123 Nov 03 02:06:13.519718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 410/804] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:14.475091 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:14.475703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:14.482100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:14.482573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:14.483433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:14.483811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:14.487357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-bd7a2070-1bc1-4131-a69b-dd41d9509e72 req-01d79689-3193-436a-af0a-3906c33eadfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:14.490464 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:14.490464 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:14.499453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-bd7a2070-1bc1-4131-a69b-dd41d9509e72 req-01d79689-3193-436a-af0a-3906c33eadfe service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:14.499890 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-bd7a2070-1bc1-4131-a69b-dd41d9509e72 req-01d79689-3193-436a-af0a-3906c33eadfe service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:14.510636 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-bd7a2070-1bc1-4131-a69b-dd41d9509e72 req-01d79689-3193-436a-af0a-3906c33eadfe service nova] Creating event network-changed:9fede95c-7a4c-431b-802a-bfb045b4ba84 for instance bfcedc8e-ab45-4300-9e60-6e82319256b8 on hv-cinder-81561 Nov 03 02:06:14.516260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:14.516466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-bd7a2070-1bc1-4131-a69b-dd41d9509e72 req-01d79689-3193-436a-af0a-3906c33eadfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033034 Nov 03 02:06:14.516805 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:14.517271 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 411/805] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:06:14.517433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lazy-loading 'fault' on Instance uuid bd5ec1d9-6496-4b0d-8c10-6506ec67049e {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:14.571945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:14.580215 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8ed0cc82-ed92-4aa8-b4e2-771f9a3bf6c6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 200 len: 1308 microversion: 2.1 time: 0.108657 Nov 03 02:06:14.580901 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 395/806] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:14 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:15.597668 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:15.598471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: bd5ec1d9-6496-4b0d-8c10-6506ec67049e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:15.604976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:15.605471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:15.606479 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:15.606911 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:15.621400 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] HTTP exception thrown: Instance bd5ec1d9-6496-4b0d-8c10-6506ec67049e could not be found. Nov 03 02:06:15.622330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Returning 404 to user: Instance bd5ec1d9-6496-4b0d-8c10-6506ec67049e could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:06:15.623545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-517f50b6-02f0-49cd-9adb-2fbf96800a28 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e" status: 404 len: 111 microversion: 2.1 time: 0.030476 Nov 03 02:06:15.624233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 412/807] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:15 2021] GET /compute/v2.1/servers/bd5ec1d9-6496-4b0d-8c10-6506ec67049e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:06:18.325764 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:18.326487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:18.332636 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:18.333074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:18.333833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:18.334289 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:18.362691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dfe6c61f-1c50-4605-8b16-b5925416e331 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments/68bd3853-4820-4b9f-916f-b1deaa5f7ba5" status: 200 len: 194 microversion: 2.20 time: 0.040645 Nov 03 02:06:18.363270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 396/808] 10.222.0.30 () {60 vars in 1453 bytes} [Wed Nov 3 02:06:18 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments/68bd3853-4820-4b9f-916f-b1deaa5f7ba5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:06:18.421779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:18.422312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:18.428439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:18.428881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:18.429655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:18.430074 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:18.505225 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lazy-loading 'services' on Instance uuid c1203383-0300-4df4-8d34-0d52ac57e83d {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:18.727144 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9fb0cff8-7646-480e-ba20-745aec47b347 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments/68bd3853-4820-4b9f-916f-b1deaa5f7ba5" status: 202 len: 0 microversion: 2.20 time: 0.309016 Nov 03 02:06:18.727732 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 413/809] 10.222.0.30 () {60 vars in 1456 bytes} [Wed Nov 3 02:06:18 2021] DELETE /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments/68bd3853-4820-4b9f-916f-b1deaa5f7ba5 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:06:18.736229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:18.737192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:18.743414 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:18.743881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:18.744701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:18.745146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:18.775370 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4006fce3-0b07-42df-bc9b-8a644347d8f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043009 Nov 03 02:06:18.775919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 397/810] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Nov 3 02:06:18 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:06:19.151764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:19.152491 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:19.158682 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.159128 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.159887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.160312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.189512 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Going to try to terminate instance {{(pid=123012) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:06:19.402772 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:19.403948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:19.411104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.411665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.414297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.414297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.507081 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f00d9af1-d33e-49af-8772-2cc8ba67d4e0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 204 len: 0 microversion: 2.1 time: 0.358179 Nov 03 02:06:19.510062 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 414/811] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:06:19 2021] DELETE /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:06:19.521272 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:19.521964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:19.528135 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.528573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.529333 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.529757 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.670673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:19.677895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ad909f48-2aaf-471c-8029-5f4a8d932440 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1514 microversion: 2.1 time: 0.160559 Nov 03 02:06:19.678724 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 415/812] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:19 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:19.709655 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-078acb6e-48a8-4cc8-b679-35e1a6a636af tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/action" status: 202 len: 0 microversion: 2.1 time: 0.311676 Nov 03 02:06:19.710510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 398/813] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:06:19 2021] POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:06:19.721898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:19.722603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:19.729000 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.729612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.733172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.733172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.791201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:19.792410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:19.803232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.804573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.805821 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:19.806451 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:19.844974 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-82c4d97f-1943-47dd-9a6b-b42b21d86e15 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060532 Nov 03 02:06:19.845684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 399/814] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Nov 3 02:06:19 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:06:19.889002 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:19.896720 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8b4ca811-89d9-4d4b-be9c-c090ce254497 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1749 microversion: 2.1 time: 0.179183 Nov 03 02:06:19.897283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 416/815] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:19 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:20.694933 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:20.695595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:20.701912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.702416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.703177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.703595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.854967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:20.857162 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:20.858183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:20.864048 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d4da84e1-d753-4f2a-a48a-6844fda7b0ba tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1514 microversion: 2.1 time: 0.172793 Nov 03 02:06:20.864502 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.864834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 400/816] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:20 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:20.866152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.866942 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.867369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.904384 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9cf9af34-eba8-4341-a7b5-8a0db14c3aa6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051681 Nov 03 02:06:20.905404 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 417/817] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Nov 3 02:06:20 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:20.914425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:20.914950 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:20.921593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.922045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.922846 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.923275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.965971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:20.965971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:20.970893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.971746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:20.972612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:20.973059 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:21.005644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Going to try to terminate instance {{(pid=123012) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:06:21.075978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:21.083893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-19cf7847-d0ba-4c23-b47f-3d53ec9b20cb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.173160 Nov 03 02:06:21.084448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 401/818] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:20 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:21.316192 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a537c833-4330-42b4-a666-a86233da7ebd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 204 len: 0 microversion: 2.20 time: 0.355780 Nov 03 02:06:21.318824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 418/819] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Nov 3 02:06:20 2021] DELETE /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 02:06:21.324905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:21.325540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:21.331352 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:21.331798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:21.332563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:21.332996 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:21.495596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:21.503717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:21.505211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:21.506435 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6c871551-c809-4375-8d3d-729674966ea7 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.185179 Nov 03 02:06:21.506999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 402/820] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:21 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:21.881605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:21.882341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:21.889051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:21.889728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:21.890586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:21.891019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:22.032087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:22.039314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b3706957-396b-4ff5-ab8f-fadc1f719683 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1514 microversion: 2.1 time: 0.161884 Nov 03 02:06:22.039881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 419/821] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:21 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:22.101482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:22.102057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:22.115550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:22.115550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:22.116038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:22.116748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:22.175983 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-e76b5189-a29a-498a-84ab-2a84ea19f04f req-db2f9bd4-a270-4d45-bcf3-dc3ed1d34855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b0b0ce-2322-4f89-9a79-3efd949ae8ce", "name": "network-vif-deleted", "tag": "ff09ef64-e5d7-4f1b-a870-3f00abdc5961"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:22.177566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:22.177566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:22.185707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e76b5189-a29a-498a-84ab-2a84ea19f04f req-db2f9bd4-a270-4d45-bcf3-dc3ed1d34855 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:22.186168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e76b5189-a29a-498a-84ab-2a84ea19f04f req-db2f9bd4-a270-4d45-bcf3-dc3ed1d34855 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:22.217439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-e76b5189-a29a-498a-84ab-2a84ea19f04f req-db2f9bd4-a270-4d45-bcf3-dc3ed1d34855 service nova] Creating event network-vif-deleted:ff09ef64-e5d7-4f1b-a870-3f00abdc5961 for instance e8b0b0ce-2322-4f89-9a79-3efd949ae8ce on hv-cinder-81561 Nov 03 02:06:22.232851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-e76b5189-a29a-498a-84ab-2a84ea19f04f req-db2f9bd4-a270-4d45-bcf3-dc3ed1d34855 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060344 Nov 03 02:06:22.239010 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 420/822] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:22.301216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:22.317578 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8e2354b5-c6a5-4907-8699-841b304bcf66 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.219428 Nov 03 02:06:22.339947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 403/823] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:22 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:22.525829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:22.526658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:22.533231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:22.533685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:22.534493 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:22.534927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:22.669680 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:22.677264 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:22.678793 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:22.679938 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a1b05061-00f6-450e-b71b-761daeaa3c60 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.158230 Nov 03 02:06:22.680673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 421/824] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:22 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:23.055988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:23.056594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:23.062871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.067521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.067521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.067521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.097375 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.097827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.098313 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lazy-loading 'fault' on Instance uuid e8b0b0ce-2322-4f89-9a79-3efd949ae8ce {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:23.150391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:23.160013 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3ac90265-fa82-4ee4-b5e2-de00d5718fe5 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 200 len: 1308 microversion: 2.1 time: 0.107534 Nov 03 02:06:23.160803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 404/825] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:23 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:23.334782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:23.337322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:23.341639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.342091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.342899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.343326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.492223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:23.500582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b34fb3ee-35cc-4bb5-b0de-07d50aeaa27c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.169420 Nov 03 02:06:23.501149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 422/826] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:23 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:23.703590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:23.704183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:23.710080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.710828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.711607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:23.712040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:23.844349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:23.852387 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:23.853930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:23.855700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8705c4c3-731a-4d84-ae44-296be1bce8c2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1724 microversion: 2.20 time: 0.155334 Nov 03 02:06:23.856331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 405/827] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:23 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:24.180252 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:24.182721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: e8b0b0ce-2322-4f89-9a79-3efd949ae8ce] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:24.193380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.193931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.194887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.195791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.213901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] HTTP exception thrown: Instance e8b0b0ce-2322-4f89-9a79-3efd949ae8ce could not be found. Nov 03 02:06:24.215113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Returning 404 to user: Instance e8b0b0ce-2322-4f89-9a79-3efd949ae8ce could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:06:24.216054 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-867380eb-f539-4f0d-bfd6-8c2793f473ea tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce" status: 404 len: 111 microversion: 2.1 time: 0.041991 Nov 03 02:06:24.224695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:24.225235 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:24.233499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 423/828] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:24 2021] GET /compute/v2.1/servers/e8b0b0ce-2322-4f89-9a79-3efd949ae8ce => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:06:24.238302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.238945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.239844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.240382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.271452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:06:24.483294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-6cda6bfe-d03f-461a-813a-89323db4397c req-14e6d594-7191-4f57-a638-1acffda9e3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1203383-0300-4df4-8d34-0d52ac57e83d", "name": "network-vif-deleted", "tag": "200c1df3-d8a9-42db-83ec-6723cdbe5701"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:24.485627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:24.485627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:24.493150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-6cda6bfe-d03f-461a-813a-89323db4397c req-14e6d594-7191-4f57-a638-1acffda9e3bf service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.493987 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-6cda6bfe-d03f-461a-813a-89323db4397c req-14e6d594-7191-4f57-a638-1acffda9e3bf service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.507278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-6cda6bfe-d03f-461a-813a-89323db4397c req-14e6d594-7191-4f57-a638-1acffda9e3bf service nova] Creating event network-vif-deleted:200c1df3-d8a9-42db-83ec-6723cdbe5701 for instance c1203383-0300-4df4-8d34-0d52ac57e83d on hv-cinder-81561 Nov 03 02:06:24.513319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-6cda6bfe-d03f-461a-813a-89323db4397c req-14e6d594-7191-4f57-a638-1acffda9e3bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Nov 03 02:06:24.513917 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 424/829] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:06:24.519849 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:24.520715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:24.527133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.527592 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.528541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.528969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.663395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a938b291-9e62-4a89-9d22-4bb1cbfaa5b0 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 204 len: 0 microversion: 2.1 time: 0.438486 Nov 03 02:06:24.666673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 406/830] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:06:24 2021] DELETE /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:06:24.679738 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:24.681769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:24.693350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.694030 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.695073 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.695668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.739825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:24.748727 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-eb662d5c-fff6-40d4-8ec3-3d5bc531298f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.233532 Nov 03 02:06:24.750196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 425/831] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:24 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:24.863043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:24.872223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dd15a587-e5fc-4196-bde4-ee38b4ee6d5e tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1513 microversion: 2.1 time: 0.200858 Nov 03 02:06:24.874004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:24.874830 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:24.879654 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 407/832] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:24 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:24.880947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.881568 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.882567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.883005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.914898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:24.915341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:24.915782 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lazy-loading 'fault' on Instance uuid c1203383-0300-4df4-8d34-0d52ac57e83d {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:24.956951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:24.965260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:24.966796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:24.967939 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fb299c7a-6c4c-4151-a54a-890621153f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1370 microversion: 2.20 time: 0.097652 Nov 03 02:06:24.969209 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 426/833] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:24 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:06:25.766485 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:25.767074 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:25.773325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:25.773832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:25.774618 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:25.775045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:25.888965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:25.889715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:25.896096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:25.896540 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:25.897373 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:25.897798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:25.923206 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:25.930915 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7c930ac2-5eed-48a6-94db-eb930cc2c8c4 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.168013 Nov 03 02:06:25.931477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 408/834] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:25 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:25.986335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:25.986941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:25.993789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:25.994266 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:25.995040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:25.995472 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:26.025501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:26.025948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:26.026416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lazy-loading 'fault' on Instance uuid c1203383-0300-4df4-8d34-0d52ac57e83d {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:26.031622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:26.039325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4a5a27bb-0ba9-4546-b589-515ac1ac8a13 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1513 microversion: 2.1 time: 0.154493 Nov 03 02:06:26.040145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 427/835] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:25 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:26.066635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:26.074956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:26.077113 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:26.077594 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3572eef4-496c-4e99-a4cb-a90d51ae38cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1370 microversion: 2.20 time: 0.094864 Nov 03 02:06:26.078489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 409/836] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:25 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:06:26.948443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:26.948999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:26.955282 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:26.955721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:26.956479 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:26.956910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:27.055776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:27.056406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:27.063364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:27.064008 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:27.065069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:27.065679 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:27.107590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:27.116439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b9f15dfc-7d89-4259-8b6d-15906e172457 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.171872 Nov 03 02:06:27.118559 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 428/837] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:26 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:27.123976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:27.124398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:27.132996 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:27.133530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:27.134480 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:27.135240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:27.180517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:27.181190 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:27.181731 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lazy-loading 'fault' on Instance uuid c1203383-0300-4df4-8d34-0d52ac57e83d {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:27.234075 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:27.239107 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:27.245500 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:27.246311 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b874fc10-e27c-40e4-82b7-c87b6fd73435 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1513 microversion: 2.1 time: 0.194591 Nov 03 02:06:27.246884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 410/838] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:27 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:27.248502 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:27.249973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-356bef9c-75dd-4eb9-8451-61ae29d03bdd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 200 len: 1370 microversion: 2.20 time: 0.130391 Nov 03 02:06:27.250631 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 429/839] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:27 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 1370 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:28.133583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:28.134207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:28.140911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:28.141346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:28.142105 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:28.142604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:28.263454 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:28.264025 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:28.270510 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:28.271148 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:28.271914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:28.272338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:28.295267 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:28.303378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-62bc0ee4-3691-41bc-aa41-8499d749103c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.173409 Nov 03 02:06:28.304324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 411/840] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:28 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:28.312900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:28.313741 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:28.319587 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:28.320297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:28.321218 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:28.321748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:28.335555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] HTTP exception thrown: Instance c1203383-0300-4df4-8d34-0d52ac57e83d could not be found. Nov 03 02:06:28.336538 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Returning 404 to user: Instance c1203383-0300-4df4-8d34-0d52ac57e83d could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:06:28.337359 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-65534465-149f-4c53-8fb5-ecc50d547a1f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 404 len: 111 microversion: 2.20 time: 0.032065 Nov 03 02:06:28.338061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 412/841] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:28 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:06:28.346788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-690ddc65-1ad2-4ddd-a3c2-88de9c6bf2c6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '.version_select at 0x7f30c4613ee0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:28.410687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:28.418316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-53505b22-a64c-479a-94e9-2b5cf554e4e2 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1513 microversion: 2.1 time: 0.158963 Nov 03 02:06:28.418887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 430/842] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:28 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:28.429973 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-690ddc65-1ad2-4ddd-a3c2-88de9c6bf2c6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359087626" status: 204 len: 0 microversion: 2.20 time: 0.086681 Nov 03 02:06:28.430583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 413/843] 10.222.0.30 () {60 vars in 1261 bytes} [Wed Nov 3 02:06:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359087626 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 02:06:29.308830 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b264c7b3-d113-497d-948e-238bd36a0d3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'create', calling method: .version_select at 0x7f30b7c2e9d0>, body: {"keypair": {"name": "tempest-keypair-1335730212"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:29.322954 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:29.324405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:29.327789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b264c7b3-d113-497d-948e-238bd36a0d3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:06:29.332045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:29.332229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b264c7b3-d113-497d-948e-238bd36a0d3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for user c5de27df6f294e9f9c40f6b14315a228 and project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:06:29.332742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:29.333590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:29.334088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:29.492455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:29.501645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-68492484-99c7-4c34-8884-6e8a1577e036 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.184836 Nov 03 02:06:29.502566 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 414/844] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:29 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:29.507928 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:29.508676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:29.519799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:29.520528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:29.521478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:29.522069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:29.586592 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:29.594869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-71ba9f0f-4e58-45fd-a208-1c2c13b8ae91 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 200 len: 1471 microversion: 2.1 time: 0.091099 Nov 03 02:06:29.595445 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 415/845] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:29 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:29.605532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-2f96c405-8d47-42d9-b381-231ef9d5bc4d req-d63818ed-c056-4bcb-a458-a4ab56d466c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea", "name": "network-vif-deleted", "tag": "b86f86db-8a25-4da3-abaa-8e726628e287"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:29.607078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:29.607078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:06:29.614652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-2f96c405-8d47-42d9-b381-231ef9d5bc4d req-d63818ed-c056-4bcb-a458-a4ab56d466c8 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:29.615668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-2f96c405-8d47-42d9-b381-231ef9d5bc4d req-d63818ed-c056-4bcb-a458-a4ab56d466c8 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:29.627383 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b264c7b3-d113-497d-948e-238bd36a0d3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:06:29.628664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-2f96c405-8d47-42d9-b381-231ef9d5bc4d req-d63818ed-c056-4bcb-a458-a4ab56d466c8 service nova] Creating event network-vif-deleted:b86f86db-8a25-4da3-abaa-8e726628e287 for instance ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea on hv-cinder-81561 Nov 03 02:06:29.630945 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b264c7b3-d113-497d-948e-238bd36a0d3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for user c5de27df6f294e9f9c40f6b14315a228 and project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:06:29.633418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-2f96c405-8d47-42d9-b381-231ef9d5bc4d req-d63818ed-c056-4bcb-a458-a4ab56d466c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035461 Nov 03 02:06:29.634419 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 416/846] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:29.644586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b264c7b3-d113-497d-948e-238bd36a0d3a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.339517 Nov 03 02:06:29.645353 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 431/847] 10.222.0.30 () {62 vars in 1198 bytes} [Wed Nov 3 02:06:29 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 03 02:06:30.520320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:30.521012 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:30.532431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:30.532431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:30.533104 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:30.533540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:30.612828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:30.613526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:30.625303 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:30.625303 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:30.626437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:30.626942 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:30.644958 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] HTTP exception thrown: Instance ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea could not be found. Nov 03 02:06:30.645638 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Returning 404 to user: Instance ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:06:30.646680 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f8bf3b3e-fca9-4fc8-8764-bbeef7d47ff3 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea" status: 404 len: 111 microversion: 2.1 time: 0.037977 Nov 03 02:06:30.647320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 432/848] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:30 2021] GET /compute/v2.1/servers/ab4c0908-93e6-4c60-8da3-a8bb3b8b24ea => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:06:30.708531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:30.717767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-468c6715-e524-402c-9e1d-b32f00ce4a6e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.202088 Nov 03 02:06:30.733558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 417/849] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:30 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:31.747247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:31.747868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:31.754063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:31.754541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:31.755379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:31.755816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:31.910387 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:31.912845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:31.921536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:31.924085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:31.924085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:31.924085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:31.950662 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:06:31.985497 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:31.993240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b7e81391-ef5c-4545-845f-ec325f8ee254 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.249681 Nov 03 02:06:31.993812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 433/850] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:31 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:32.191649 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-460883973", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1e77ce4-6f11-46e6-a0fa-324d2dbee8c9"}], "security_groups": [{"name": "tempest-securitygroup--28582916"}], "key_name": "tempest-keypair-1335730212", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:32.302931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] validate_networks() for [('f1e77ce4-6f11-46e6-a0fa-324d2dbee8c9', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:06:32.311071 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-aff92efd-7921-41bc-bf8e-a2b151a4f822 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 204 len: 0 microversion: 2.1 time: 0.404064 Nov 03 02:06:32.311752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 418/851] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:06:31 2021] DELETE /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:06:32.319642 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:32.320331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:32.326924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:32.327370 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:32.328134 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:32.328558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:32.557071 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:32.569945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-62af8342-04ac-46dd-a643-60f39487928d tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1515 microversion: 2.1 time: 0.254061 Nov 03 02:06:32.570806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 419/852] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:32 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:32.766315 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:06:32.766753 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:06:32.767113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:06:32.767626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:06:32.768092 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:06:32.778838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:32.779287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:32.780089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:32.780522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:32.796713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:06:32.800572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Getting quotas for user c5de27df6f294e9f9c40f6b14315a228 and project 86777c3ab41c4ea8bbbdf156c7792513. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:06:32.811559 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:06:32.813869 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:06:32.940445 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cda6fd9b-1303-4fef-b9af-cb9cff11cecf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.752694 Nov 03 02:06:32.941380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 434/853] 10.222.0.30 () {62 vars in 1187 bytes} [Wed Nov 3 02:06:32 2021] POST /compute/v2.1/servers => generated 400 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 03 02:06:32.952114 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1de86479-bd2a-4d5f-825e-19bacf5a0280 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:32.952806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1de86479-bd2a-4d5f-825e-19bacf5a0280 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:33.010073 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:33.012406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:33.016211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1de86479-bd2a-4d5f-825e-19bacf5a0280 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:33.018617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:33.019189 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:33.020216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:33.020739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:33.023365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1de86479-bd2a-4d5f-825e-19bacf5a0280 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:33.025124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1de86479-bd2a-4d5f-825e-19bacf5a0280 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:33.028123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1de86479-bd2a-4d5f-825e-19bacf5a0280 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1281 microversion: 2.20 time: 0.079492 Nov 03 02:06:33.029170 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 420/854] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:32 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:06:33.174547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:33.182439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fefcfa65-6a82-43d5-bc41-cf634d7b5dcc tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.175869 Nov 03 02:06:33.183003 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 435/855] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:33 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:33.587335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:33.588323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:33.595561 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:33.596005 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:33.596776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:33.597209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:33.741507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:33.749316 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7479ad40-e9ec-46a2-ba67-ccce436703a4 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1515 microversion: 2.1 time: 0.166020 Nov 03 02:06:33.751024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 421/856] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:33 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:34.054582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:34.055182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:34.061798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.062412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.063190 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.063622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.124261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:34.131949 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:34.133422 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:34.134604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-da31c148-6ce8-4d84-9be9-fb9c62df06cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1285 microversion: 2.20 time: 0.083913 Nov 03 02:06:34.135160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 436/857] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:34 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:34.200980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:34.201695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:34.214080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.215405 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.216488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.216972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.374219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:34.389948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f3351d4b-2739-47af-aea4-7ee49695314c tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.193730 Nov 03 02:06:34.391077 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 422/858] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:34 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:34.725316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-b5e602ef-cf65-4035-abe7-b7ff6c888462 req-1c9c0299-8aad-46f2-8758-6405dbdc4f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7ffd60-ded0-4044-8e50-f1acf30e9dfd", "name": "network-vif-deleted", "tag": "aef52f3c-1a62-45b5-9c4b-40ee0869774e"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:34.726932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:34.726932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:34.733850 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-b5e602ef-cf65-4035-abe7-b7ff6c888462 req-1c9c0299-8aad-46f2-8758-6405dbdc4f82 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.734319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-b5e602ef-cf65-4035-abe7-b7ff6c888462 req-1c9c0299-8aad-46f2-8758-6405dbdc4f82 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.744824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-b5e602ef-cf65-4035-abe7-b7ff6c888462 req-1c9c0299-8aad-46f2-8758-6405dbdc4f82 service nova] Creating event network-vif-deleted:aef52f3c-1a62-45b5-9c4b-40ee0869774e for instance df7ffd60-ded0-4044-8e50-f1acf30e9dfd on hv-cinder-81561 Nov 03 02:06:34.750633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-b5e602ef-cf65-4035-abe7-b7ff6c888462 req-1c9c0299-8aad-46f2-8758-6405dbdc4f82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029125 Nov 03 02:06:34.751222 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 437/859] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:34.766575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:34.767210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:34.772860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.773304 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.774067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:34.774523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:34.833494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:34.840702 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-abd7adfd-6138-4296-916b-444e03e6e185 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1473 microversion: 2.1 time: 0.077834 Nov 03 02:06:34.841273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 423/860] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:34 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1473 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:35.152326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:35.153665 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:35.160923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.161375 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.162181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.162616 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.228973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:35.237953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:35.239663 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:35.241320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f64eaf29-3c14-44f3-89dc-c1690affa03f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1341 microversion: 2.20 time: 0.092713 Nov 03 02:06:35.250325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 438/861] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:35 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1341 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:35.407491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:35.410647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:35.416876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.420372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.420372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.420372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.584050 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:35.594282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-936903c2-936a-404c-a4d6-5b3de751c6eb tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.190382 Nov 03 02:06:35.595150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 424/862] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:35 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:35.857185 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:35.857788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:35.863433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.863873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.864640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.865076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.894201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:35.894642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:35.895099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lazy-loading 'fault' on Instance uuid df7ffd60-ded0-4044-8e50-f1acf30e9dfd {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:06:35.935050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c920199e7537410989d8118aecfeb6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a236a1ddacc947d0a25090b1c2ef1456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:35.942610 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f3108ab5-c565-44e9-beb7-374579c69de6 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 200 len: 1308 microversion: 2.1 time: 0.089053 Nov 03 02:06:35.947390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 439/863] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:35 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:36.259240 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:36.259962 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:36.266520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.267764 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.268007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.268539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.399624 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:36.407353 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:36.408825 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:36.409917 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-11e28547-c8b0-475b-ba87-1d1a129b2395 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1405 microversion: 2.20 time: 0.154498 Nov 03 02:06:36.410503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 425/864] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:36 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:36.612354 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:36.613018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:36.619198 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.619637 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.620402 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.621452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.820157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:36.828700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0148c153-be65-4066-b323-dd67ff73d785 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.219823 Nov 03 02:06:36.829278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 440/865] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:36 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:36.959869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:36.960480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] [instance: df7ffd60-ded0-4044-8e50-f1acf30e9dfd] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:36.970385 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.978102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.978102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.978102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.978459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-c498d505-045c-4527-b36a-aa1bd83cf7ba req-7bbfdda6-df2e-44c0-8748-0dcd179f915a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:36.978459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:36.978459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:36.983027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-c498d505-045c-4527-b36a-aa1bd83cf7ba req-7bbfdda6-df2e-44c0-8748-0dcd179f915a service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:36.983473 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-c498d505-045c-4527-b36a-aa1bd83cf7ba req-7bbfdda6-df2e-44c0-8748-0dcd179f915a service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:36.992162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] HTTP exception thrown: Instance df7ffd60-ded0-4044-8e50-f1acf30e9dfd could not be found. Nov 03 02:06:36.994711 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-c498d505-045c-4527-b36a-aa1bd83cf7ba req-7bbfdda6-df2e-44c0-8748-0dcd179f915a service nova] Creating event network-changed:53f57377-fc10-41c9-b2f6-7fbdab22b983 for instance 40c561cb-543d-469c-a637-70cdf610d8a5 on hv-cinder-81561 Nov 03 02:06:36.998809 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] Returning 404 to user: Instance df7ffd60-ded0-4044-8e50-f1acf30e9dfd could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:06:36.999492 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-c498d505-045c-4527-b36a-aa1bd83cf7ba req-7bbfdda6-df2e-44c0-8748-0dcd179f915a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035645 Nov 03 02:06:37.000268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a8e506b4-8fd3-43fb-9601-7412b2610b07 tempest-AttachVolumeNegativeTest-736474391 tempest-AttachVolumeNegativeTest-736474391-project] 10.222.0.30 "GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd" status: 404 len: 111 microversion: 2.1 time: 0.043664 Nov 03 02:06:37.000522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 441/866] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:37.004163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 426/867] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:36 2021] GET /compute/v2.1/servers/df7ffd60-ded0-4044-8e50-f1acf30e9dfd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:06:37.429697 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:37.430576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:37.436892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:37.437639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:37.438681 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:37.439191 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:37.850669 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:37.851834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:37.864641 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:37.864641 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:37.864641 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:37.864641 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:37.897453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:37.901242 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:37.902790 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:37.903887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3ec44249-42c1-4c90-ad2a-95904f4b8e1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1405 microversion: 2.20 time: 0.479068 Nov 03 02:06:37.904685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 442/868] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:37 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:38.051992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:38.060780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-418eea7d-47cf-45b9-b1a4-cceb61de3e16 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1754 microversion: 2.1 time: 0.217825 Nov 03 02:06:38.065672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 427/869] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:37 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:38.920498 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:38.921106 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:38.927478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:38.927921 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:38.928709 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:38.929139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:39.068150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:39.077789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:39.079213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:39.079906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:39.080289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:39.081781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4a9a9a0c-899a-45f9-8d0c-61a005f482db tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1405 microversion: 2.20 time: 0.164984 Nov 03 02:06:39.082864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 443/870] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:38 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:39.091701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:39.092419 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:39.093663 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:39.094302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:39.251129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:39.258993 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b05c3508-46b0-4fca-8462-0048160cf2de tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1757 microversion: 2.1 time: 0.184461 Nov 03 02:06:39.259559 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 428/871] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:06:39 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:06:40.100337 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:40.101278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:40.114022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:40.114022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:40.114022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:40.114022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:40.274655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:40.283625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:40.285232 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:40.286484 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d9d7aebb-8eba-4b4c-a004-194783859c24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1405 microversion: 2.20 time: 0.190229 Nov 03 02:06:40.287276 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 444/872] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:40 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:06:41.304524 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:41.305151 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:41.311703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:41.312161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:41.312940 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:41.313375 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:41.498507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:41.507448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:41.508971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:41.510536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3a84a1f9-c52f-47ac-9b97-1ba8b3f774cd tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1405 microversion: 2.20 time: 0.209263 Nov 03 02:06:41.511079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 429/873] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:41 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:41.897941 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-efe147f2-71c5-447f-ba69-77fe8a3c6fe1 req-3e10714a-3ee9-4881-8695-ca11c2c86d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "name": "network-vif-plugged", "status": "completed", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:41.899954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:41.899954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:06:41.908528 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-efe147f2-71c5-447f-ba69-77fe8a3c6fe1 req-3e10714a-3ee9-4881-8695-ca11c2c86d03 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:41.908970 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-efe147f2-71c5-447f-ba69-77fe8a3c6fe1 req-3e10714a-3ee9-4881-8695-ca11c2c86d03 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:41.920757 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-efe147f2-71c5-447f-ba69-77fe8a3c6fe1 req-3e10714a-3ee9-4881-8695-ca11c2c86d03 service nova] Creating event network-vif-plugged:53f57377-fc10-41c9-b2f6-7fbdab22b983 for instance 40c561cb-543d-469c-a637-70cdf610d8a5 on hv-cinder-81561 Nov 03 02:06:41.925646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-efe147f2-71c5-447f-ba69-77fe8a3c6fe1 req-3e10714a-3ee9-4881-8695-ca11c2c86d03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031772 Nov 03 02:06:41.926562 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 445/874] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:42.528863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:42.529476 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:42.536229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:42.536676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:42.537686 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:42.538121 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:42.729528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:42.738452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:42.739939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:42.741053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6d41bbb6-046d-45bd-b854-b1bfdbd74f82 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1405 microversion: 2.20 time: 0.216613 Nov 03 02:06:42.741618 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 430/875] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:42 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:43.763001 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:43.764325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:43.770955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:43.771408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:43.772189 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:43.772620 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:43.902302 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:43.912297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:43.914155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:06:43.923438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-893b5514-9d30-41c2-a7bf-a642f42228fe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1597 microversion: 2.20 time: 0.160530 Nov 03 02:06:43.924428 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 446/876] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:06:43 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:06:43.942303 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:06:43.942919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:43.949622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:43.950069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:43.951047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:43.952261 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:44.035709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-411dc542-bd36-449e-a879-1f14d5397015 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097454 Nov 03 02:06:44.036302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 431/877] 10.222.0.30 () {60 vars in 1315 bytes} [Wed Nov 3 02:06:43 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:06:45.368223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:45.368717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-928b6581-b4d1-4651-9017-314fb2e3a994 req-aacc9be9-4c3a-4494-9242-b750b2ebf56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:45.370695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:06:45.370695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:06:45.375533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:45.381685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-928b6581-b4d1-4651-9017-314fb2e3a994 req-aacc9be9-4c3a-4494-9242-b750b2ebf56c service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:45.382788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-928b6581-b4d1-4651-9017-314fb2e3a994 req-aacc9be9-4c3a-4494-9242-b750b2ebf56c service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:45.386695 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:45.387145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:45.388347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:45.388347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:45.396666 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-928b6581-b4d1-4651-9017-314fb2e3a994 req-aacc9be9-4c3a-4494-9242-b750b2ebf56c service nova] Creating event network-changed:53f57377-fc10-41c9-b2f6-7fbdab22b983 for instance 40c561cb-543d-469c-a637-70cdf610d8a5 on hv-cinder-81561 Nov 03 02:06:45.402533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-928b6581-b4d1-4651-9017-314fb2e3a994 req-aacc9be9-4c3a-4494-9242-b750b2ebf56c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039679 Nov 03 02:06:45.403794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 432/878] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:06:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:06:45.471395 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bbe341ac-48c8-44c0-8c1d-c4f20849c106 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.110968 Nov 03 02:06:45.472211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 447/879] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:45 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:46.483700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:46.484643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:46.490790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:46.491233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:46.492001 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:46.492429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:46.557138 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-80806d29-89c2-4349-9a6e-5c3d4b7f0242 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.077942 Nov 03 02:06:46.557887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 433/880] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:46 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:47.570198 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:47.572488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:47.579776 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:47.580326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:47.583810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:47.583810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:47.641501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-80a7ddb0-ffc0-414a-8b05-e9d0ba0abf80 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.075848 Nov 03 02:06:47.644705 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 448/881] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:47 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:48.652659 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:48.653724 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:48.660559 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:48.660998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:48.661753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:48.662269 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:48.721943 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-24e2a3a1-769b-4e43-b5c6-b3cf36272a2f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.073181 Nov 03 02:06:48.722643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 434/882] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:48 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:49.732992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:49.733989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:49.741017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:49.741570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:49.742650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:49.743087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:49.803676 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-38e63f8d-3c52-488b-9b9d-fd6fbc1c0810 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.074899 Nov 03 02:06:49.804451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 449/883] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:49 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:50.816299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:50.817219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:50.823951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:50.824714 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:50.825157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:50.825596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:50.907189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bfdb17c8-2261-474c-8a69-9dc5470be3a4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.094944 Nov 03 02:06:50.908822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 435/884] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:50 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:51.918476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:51.919484 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:51.926291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:51.926740 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:51.927508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:51.927940 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:53.743947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7ad7f1b2-8fd0-46e3-a1dc-89538a56a814 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 1.829316 Nov 03 02:06:53.747244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 450/885] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:51 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:54.755964 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:54.757093 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:54.764780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:54.765224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:54.765989 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:54.766441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:54.831693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-96184e5c-37ac-4597-b092-e2fc3356bc66 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 14 microversion: 2.20 time: 0.079778 Nov 03 02:06:54.832643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 436/886] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:54 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:06:56.002522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:56.003657 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:56.009575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:56.010021 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:56.010823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:56.011256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:58.494090 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3f97ecd0-d1aa-4f4d-b5c5-ba8bd3520045 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 17602 microversion: 2.20 time: 2.652438 Nov 03 02:06:58.494780 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 451/887] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:55 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 17602 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:06:59.506361 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:06:59.507379 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:06:59.514760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:59.515232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:59.515983 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:06:59.516409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:06:59.594508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d625e46e-2430-4447-a164-5b8429033f05 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 18155 microversion: 2.20 time: 0.092046 Nov 03 02:06:59.595155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 437/888] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:06:59 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 18155 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:00.605272 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:00.606284 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:00.613522 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:00.613959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:00.614741 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:00.615166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:03.443277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bc0d0dbf-4ea2-4219-90b4-b16b51e135b3 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 23930 microversion: 2.20 time: 2.841860 Nov 03 02:07:03.443927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 452/889] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:00 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 23930 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:04.455040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:04.456046 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:04.462684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:04.463127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:04.463887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:04.464310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:06.768331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-889309ca-63a4-4d07-b3da-15efb983fd4f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 27563 microversion: 2.20 time: 2.316981 Nov 03 02:07:06.769881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 438/890] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:04 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 27563 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:07.782655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:07.783681 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:07.791011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:07.792966 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:07.792966 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:07.792966 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:07.881244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f69763a4-3e32-4397-9172-c83fe166fe20 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 27928 microversion: 2.20 time: 0.103622 Nov 03 02:07:07.881885 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 453/891] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:07 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 27928 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:08.893588 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:08.895562 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:08.903348 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:08.904016 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:08.905187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:08.905620 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:08.989418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a5dae429-7521-4d18-b982-8b808c1612d4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28224 microversion: 2.20 time: 0.099855 Nov 03 02:07:08.990180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 439/892] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:08 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:07:10.013076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:10.013076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:10.013076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:10.013076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:10.014357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:10.014357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:12.437068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-50ab0ef2-8dd7-4c0e-b926-fd5b293184e4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28224 microversion: 2.20 time: 2.438773 Nov 03 02:07:12.437664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 454/893] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:09 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28224 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:13.449150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:13.450368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:13.458057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:13.458590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:13.459409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:13.459827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:13.527807 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0c61e08d-25ad-4cb5-a424-1f677f996e0e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28224 microversion: 2.20 time: 0.081906 Nov 03 02:07:13.528955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 440/894] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:13 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:14.541386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:14.542357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:14.550364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:14.550808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:14.551585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:14.552021 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:14.626789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a46ffa84-ac20-4e2e-bbc6-0350eb76f1e8 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28515 microversion: 2.20 time: 0.089379 Nov 03 02:07:14.642030 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 455/895] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:14 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28515 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:15.638557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:15.639591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:15.647109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:15.669067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:15.669067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:15.669067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:18.414701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e1976110-65f1-4304-847f-aba318e1c28c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28683 microversion: 2.20 time: 2.780092 Nov 03 02:07:18.415319 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 441/896] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:15 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28683 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:19.427489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:19.428489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:19.435719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:19.436165 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:19.436937 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:19.437367 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:19.504961 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6e44eb1d-ef48-4e6e-b90e-47392376cf1a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28683 microversion: 2.20 time: 0.081399 Nov 03 02:07:19.505643 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 456/897] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:19 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28683 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:20.517486 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:20.518499 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:20.525796 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:20.526263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:20.527032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:20.527459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:20.591196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a7ecd0d0-6923-4fab-8327-efb101c09068 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28683 microversion: 2.20 time: 0.077759 Nov 03 02:07:20.591872 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 442/898] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:20 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28683 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:21.603156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:21.604129 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:21.612037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:21.612485 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:21.613246 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:21.613679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:21.677256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5a4aff44-da97-4c17-92c3-c07b42c28d11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28683 microversion: 2.20 time: 0.078035 Nov 03 02:07:21.677881 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 457/899] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:21 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28683 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:22.690307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:22.691297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:22.697978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:22.698430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:22.699185 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:22.699610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:22.788418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8a07131e-dbe7-4fc1-bcec-4267466f6258 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 28802 microversion: 2.20 time: 0.102383 Nov 03 02:07:22.789052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 443/900] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:22 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 28802 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:07:23.799813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:23.804796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:23.807546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:23.807992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:23.809063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:23.809499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:23.893179 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6158127f-e1cd-4409-b2a6-cbdd60146574 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 30513 microversion: 2.20 time: 0.097119 Nov 03 02:07:23.893832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 458/901] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:23 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 30513 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:24.905371 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:24.906335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:24.913000 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:24.913438 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:24.914214 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:24.914642 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:25.147054 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-73d13ee4-5786-48ec-877a-59d7aef11997 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 32123 microversion: 2.20 time: 0.245707 Nov 03 02:07:25.147705 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 444/902] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:24 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 32123 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:26.159556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:26.160542 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:26.167286 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:26.167726 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:26.168486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:26.168912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:26.245098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-28b135fa-8263-4724-99a2-8a82f0146bff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 33278 microversion: 2.20 time: 0.089852 Nov 03 02:07:26.245762 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 459/903] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:26 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 33278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:27.257766 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:27.258871 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:27.265576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:27.266089 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:27.266948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:27.267473 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:27.349323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4e77939f-38f3-4335-9592-555c583ba65e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 33900 microversion: 2.20 time: 0.095497 Nov 03 02:07:27.350245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 445/904] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:27 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 33900 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:28.080098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-89052705"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:28.080638 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:28.087857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:28.088306 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:28.089083 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:28.089517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:28.361842 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:28.362998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:28.370481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:28.370934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:28.371720 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:28.372154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:28.379710 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.network.security_group_api [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Removing security group 7d974952-521b-4022-8994-617d7852a30a from port 96d79956-425a-4084-b4ad-7e4e29f76595 Nov 03 02:07:28.452586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-aebe02e6-36b2-4f47-8946-869f1a1fdf6c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 34956 microversion: 2.20 time: 0.095170 Nov 03 02:07:28.457257 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 446/905] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:28 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 34956 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:28.820839 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-132ada47-0e90-4972-b2f0-dac5711d215e tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/action" status: 202 len: 0 microversion: 2.1 time: 0.744856 Nov 03 02:07:28.821922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 460/906] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:07:28 2021] POST /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:28.958895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-939baa00-ff7d-4f90-866d-41ac9abe49f4 req-884af955-c03c-4f2f-ba53-d70f6f11435a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:28.962516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:07:28.962516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:07:28.971195 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-939baa00-ff7d-4f90-866d-41ac9abe49f4 req-884af955-c03c-4f2f-ba53-d70f6f11435a service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:28.972137 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-939baa00-ff7d-4f90-866d-41ac9abe49f4 req-884af955-c03c-4f2f-ba53-d70f6f11435a service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:29.001386 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-939baa00-ff7d-4f90-866d-41ac9abe49f4 req-884af955-c03c-4f2f-ba53-d70f6f11435a service nova] Creating event network-changed:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:07:29.011911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-939baa00-ff7d-4f90-866d-41ac9abe49f4 req-884af955-c03c-4f2f-ba53-d70f6f11435a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178958 Nov 03 02:07:29.013364 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 447/907] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:07:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:07:29.464030 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:29.465367 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:29.473224 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:29.473783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:29.474693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:29.475374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:29.558883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-07cc2667-595e-4e0b-992a-4f9b11aaaf11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 36197 microversion: 2.20 time: 0.098425 Nov 03 02:07:29.559803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 461/908] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:29 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 36197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:30.158256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:30.158845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:30.164879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:30.165331 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:30.166149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:30.166596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:30.297135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lazy-loading 'services' on Instance uuid 561f8514-e68a-49fa-b7f0-ea60cb83a94e {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:07:30.520569 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-408a4349-762b-40e5-a0bf-5d23e6379cd2 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments/1d17ff2b-cd01-4655-8193-0ab6d48f04ff" status: 202 len: 0 microversion: 2.1 time: 0.366635 Nov 03 02:07:30.521439 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 448/909] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:07:30 2021] DELETE /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments/1d17ff2b-cd01-4655-8193-0ab6d48f04ff => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:30.533826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:30.535064 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:30.543730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:30.544368 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:30.545180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:30.545665 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:30.572423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:30.573459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:30.577316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c328630c-52fa-48f9-8eb4-067bdfb01a8f tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Nov 03 02:07:30.578211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 462/910] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:07:30 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:07:30.583020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:30.583462 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:30.584276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:30.584727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:30.659775 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8d86a9a9-9045-4401-9231-9fead298aa24 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 37829 microversion: 2.20 time: 0.091318 Nov 03 02:07:30.660494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 449/911] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:30 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 37829 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:31.029442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-fa469eaf-d663-464c-87d6-cdac765decb6 req-5e81f1cf-8abd-490b-8426-5a5f973346b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:31.032559 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:07:31.032559 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:07:31.040008 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-fa469eaf-d663-464c-87d6-cdac765decb6 req-5e81f1cf-8abd-490b-8426-5a5f973346b0 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:31.040783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-fa469eaf-d663-464c-87d6-cdac765decb6 req-5e81f1cf-8abd-490b-8426-5a5f973346b0 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:31.052725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-fa469eaf-d663-464c-87d6-cdac765decb6 req-5e81f1cf-8abd-490b-8426-5a5f973346b0 service nova] Creating event network-changed:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:07:31.057681 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-fa469eaf-d663-464c-87d6-cdac765decb6 req-5e81f1cf-8abd-490b-8426-5a5f973346b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033578 Nov 03 02:07:31.061627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 463/912] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:07:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:07:31.590242 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:31.591485 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:31.600992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:31.601967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:31.603094 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:31.603877 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:31.643178 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-989a20cd-733e-4a6d-9901-b6697d525bf6 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057580 Nov 03 02:07:31.643771 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 450/913] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:07:31 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:07:31.679277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:31.680285 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:31.686812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:31.689153 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:31.689153 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:31.689153 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:31.774434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3fc5a451-079b-4ee1-b2f2-42e014006757 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 38238 microversion: 2.20 time: 0.099322 Nov 03 02:07:31.775362 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 464/914] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:31 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 38238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:07:32.653826 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:32.654760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:32.661526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:32.661978 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:32.662897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:32.663329 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:32.758739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bf8b700b-d926-4360-b08d-4ccd4ef4db14 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108510 Nov 03 02:07:32.759229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 451/915] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:07:32 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:07:32.769808 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:32.770413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:32.776992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:32.777431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:32.778312 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:32.778634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:32.787660 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:32.790112 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:32.795291 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:32.795875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:32.796762 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:32.797302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:32.852797 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] HTTP exception thrown: Instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e is not attached to volume 1d17ff2b-cd01-4655-8193-0ab6d48f04ff Nov 03 02:07:32.853399 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Returning 404 to user: Instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e is not attached to volume 1d17ff2b-cd01-4655-8193-0ab6d48f04ff {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:07:32.854305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-448a7262-5bde-4c66-a17e-cab4a90fa639 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments/1d17ff2b-cd01-4655-8193-0ab6d48f04ff" status: 404 len: 154 microversion: 2.1 time: 0.089142 Nov 03 02:07:32.854859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 465/916] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:07:32 2021] DELETE /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e/os-volume_attachments/1d17ff2b-cd01-4655-8193-0ab6d48f04ff => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:07:32.857273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-28add04b-94cc-4a2f-9a3e-3606a36da622 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 38238 microversion: 2.20 time: 0.073255 Nov 03 02:07:32.858195 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 452/917] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:32 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 38238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:07:33.868757 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:33.869688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:33.876429 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:33.876865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:33.877625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:33.878052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:33.934931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-90b2c0c4-613d-4476-81e5-15835cf051cf tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 38238 microversion: 2.20 time: 0.069752 Nov 03 02:07:33.935544 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 466/918] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:33 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 38238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:07:34.159268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:34.159848 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:34.166746 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:34.167192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:34.167967 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:34.168397 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:34.193142 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:07:34.468576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2e22cad5-3df9-430e-bf87-8d43abe78cf7 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 204 len: 0 microversion: 2.1 time: 0.313525 Nov 03 02:07:34.469165 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 453/919] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:07:34 2021] DELETE /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:07:34.478364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:34.479166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:34.486646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:34.488435 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:34.488435 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:34.488435 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:34.621347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:34.628735 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-396807e1-4041-4f07-9760-bfb869a64249 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1553 microversion: 2.1 time: 0.154396 Nov 03 02:07:34.629290 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 467/920] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:07:34 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:07:34.947153 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:34.948160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:34.955717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:34.956158 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:34.956919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:34.957351 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:35.023532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-17098061-6a08-4850-9647-911bec613936 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 38238 microversion: 2.20 time: 0.080172 Nov 03 02:07:35.024390 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 454/921] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:34 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 38238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:35.645809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:35.646433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:35.652893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:35.653335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:35.654168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:35.654594 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:35.787461 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:35.794821 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f3c19078-6430-4833-aeb1-badb8d630b5a tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1553 microversion: 2.1 time: 0.152781 Nov 03 02:07:35.795624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 468/922] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:07:35 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:07:36.036743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:36.038616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:36.045481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:36.045920 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:36.046708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:36.047135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:36.129208 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-71e5234c-a27b-4602-8cf6-0ef3c1b598eb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 200 len: 38378 microversion: 2.20 time: 0.096923 Nov 03 02:07:36.129858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 455/923] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:36 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 38378 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:07:36.139862 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:36.140350 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:36.146517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:36.146964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:36.147754 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:36.148182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:36.173902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-65c6f272-1ddd-4aa7-acc2-7850d6cc1363 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/ips" status: 200 len: 152 microversion: 2.20 time: 0.037697 Nov 03 02:07:36.174524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 469/924] 10.222.0.30 () {60 vars in 1288 bytes} [Wed Nov 3 02:07:36 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:07:36.812787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:36.813932 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:36.820816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:36.821267 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:36.822039 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:36.822502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:36.888010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:36.896602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cdd44749-436d-43fe-a7e3-659ac7695c8d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1511 microversion: 2.1 time: 0.088149 Nov 03 02:07:36.897222 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 456/925] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:07:36 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:07:37.017785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-d74308d2-bb4f-4b11-afa0-3389a22db9ba req-30d4a36f-bba1-490c-99c2-e16a853b1130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561f8514-e68a-49fa-b7f0-ea60cb83a94e", "name": "network-vif-deleted", "tag": "96d79956-425a-4084-b4ad-7e4e29f76595"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:37.019525 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:07:37.019525 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:07:37.026157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-d74308d2-bb4f-4b11-afa0-3389a22db9ba req-30d4a36f-bba1-490c-99c2-e16a853b1130 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:37.026611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-d74308d2-bb4f-4b11-afa0-3389a22db9ba req-30d4a36f-bba1-490c-99c2-e16a853b1130 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:37.037107 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-d74308d2-bb4f-4b11-afa0-3389a22db9ba req-30d4a36f-bba1-490c-99c2-e16a853b1130 service nova] Creating event network-vif-deleted:96d79956-425a-4084-b4ad-7e4e29f76595 for instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e on hv-cinder-81561 Nov 03 02:07:37.042095 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-d74308d2-bb4f-4b11-afa0-3389a22db9ba req-30d4a36f-bba1-490c-99c2-e16a853b1130 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084359 Nov 03 02:07:37.042904 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 470/926] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:07:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:07:37.913278 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:37.913888 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:37.920162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:37.920610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:37.921375 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:37.921809 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:37.953343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:37.953771 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:37.954239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lazy-loading 'fault' on Instance uuid 561f8514-e68a-49fa-b7f0-ea60cb83a94e {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:07:37.993440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ee363c1764e37a737c05de0c3d67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13a412251cf4add8e72d0811966ade4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:38.000910 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-380ab98f-7439-41f3-a113-2f2a9debbc10 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 200 len: 1347 microversion: 2.1 time: 0.091358 Nov 03 02:07:38.002026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 457/927] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:07:37 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 1347 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:07:38.963874 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:38.964490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:38.970886 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:38.971372 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:38.972135 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:38.972562 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:38.994375 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lazy-loading 'flavor' on Instance uuid 40c561cb-543d-469c-a637-70cdf610d8a5 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:07:39.019555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:39.019555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] [instance: 561f8514-e68a-49fa-b7f0-ea60cb83a94e] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:39.025491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:39.025939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:39.026748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:39.027185 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:39.040296 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] HTTP exception thrown: Instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e could not be found. Nov 03 02:07:39.042504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Returning 404 to user: Instance 561f8514-e68a-49fa-b7f0-ea60cb83a94e could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:07:39.042504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dd0c233c-ec8c-4d20-97e8-29b0a93d9fc5 tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e" status: 404 len: 111 microversion: 2.1 time: 0.027384 Nov 03 02:07:39.042504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 458/928] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:07:39 2021] GET /compute/v2.1/servers/561f8514-e68a-49fa-b7f0-ea60cb83a94e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 02:07:39.049664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-012d7acc-9ff0-4afe-a3be-a2cd91b33d6d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] Calling method '.version_select at 0x7f30c44d1430>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:39.218276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-012d7acc-9ff0-4afe-a3be-a2cd91b33d6d tempest-TestMinimumBasicScenario-621125443 tempest-TestMinimumBasicScenario-621125443-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-429003493" status: 202 len: 0 microversion: 2.1 time: 0.171808 Nov 03 02:07:39.223223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 459/929] 10.222.0.30 () {58 vars in 1268 bytes} [Wed Nov 3 02:07:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-429003493 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:07:39.798942 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f83ca7a0-818f-4c41-9d1b-2a446e00e0ab tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 202 len: 0 microversion: 2.20 time: 0.838928 Nov 03 02:07:39.799604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 471/930] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:07:38 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:07:39.808851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:39.809519 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:39.816336 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:39.816781 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:39.818230 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:39.818665 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:39.958023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:39.964449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:39.965937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:39.967105 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-59a18f35-46c2-403b-8134-d62f0dff7013 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.163068 Nov 03 02:07:39.967650 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 460/931] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:39 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:07:40.985966 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:40.989631 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:40.992748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:40.993208 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:40.993952 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:40.994407 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:41.198408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:41.206586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:41.208098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:41.209241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7dc5f196-db69-4d3e-a5f9-d509bce8f68b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.227879 Nov 03 02:07:41.210176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 472/932] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:40 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:42.228470 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:42.230528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:42.248211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:42.248719 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:42.249466 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:42.250522 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:42.515453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:42.523546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:42.535912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:42.535912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-976dcf56-402d-4185-b122-647cb416f8f9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.302307 Nov 03 02:07:42.535912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 461/933] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:42 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:43.564565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:43.564565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:43.570527 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:43.571519 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:43.572463 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:43.573043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:43.767016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:43.776655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:43.778086 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:43.784923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ad97ef8f-4ee7-4b27-8653-424fa14e789d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.230415 Nov 03 02:07:43.784923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 473/934] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:43 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:44.801017 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:44.801620 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:44.808518 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:44.809265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:44.810102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:44.810569 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:44.971240 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:44.979101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:44.980568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:44.981887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e601aed1-612f-403c-b98d-bb21f680bd32 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.185184 Nov 03 02:07:44.982873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 462/935] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:44 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:46.004378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:46.005513 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:46.012067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:46.012617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:46.013519 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:46.014052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:46.203713 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:46.211811 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:46.213402 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:46.214824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7a887fe8-7366-487e-bbf6-aa49d41674ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.216987 Nov 03 02:07:46.215566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 474/936] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:45 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:47.235180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:47.236284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:47.242883 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:47.243332 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:47.244266 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:47.245482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:47.403352 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:47.412516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:47.414533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:47.416190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-00cedbf6-3f13-4b2f-948f-0114e5e9f229 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.187248 Nov 03 02:07:47.429020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 463/937] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:47 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:48.435606 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:48.436854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:48.443530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:48.443974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:48.444810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:48.445417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:48.593183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:48.602565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:48.612459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:48.612459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-00480077-eee0-49e4-bcd0-8d2564ab457f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.173580 Nov 03 02:07:48.612459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 475/938] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:48 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:49.631087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:49.631833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:49.638330 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:49.638777 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:49.639548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:49.639980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:49.776092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:49.787564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:49.789097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:49.790721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cea02541-eca8-4b89-a687-615b7cfc19ca tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.163315 Nov 03 02:07:49.791394 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 464/939] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:49 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:50.809202 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:50.809988 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:50.817308 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:50.818098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:50.819241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:50.819626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:50.968068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:50.976234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:50.977704 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:50.978870 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-06de3168-4b4a-412b-9fd7-8af0e7dc381e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1743 microversion: 2.20 time: 0.173887 Nov 03 02:07:50.979591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 476/940] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:50 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:51.998413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:51.999017 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:52.005924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:52.006411 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:52.007176 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:52.007607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:52.145895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:52.153941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:52.155459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:52.157180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8bfea7bf-668a-45cd-bfa2-2d2ac09582b2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1743 microversion: 2.20 time: 0.162013 Nov 03 02:07:52.157765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 465/941] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:51 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:07:53.176991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:53.177751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:53.183802 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:53.184248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:53.185022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:53.185451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:53.329960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:53.340050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:53.342283 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:53.349617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-67f1975d-afbf-4b7d-a667-7e04c31ebcc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.174625 Nov 03 02:07:53.350229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 477/942] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:53 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:54.371263 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:54.373097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:54.394220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:54.395410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:54.396308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:54.400151 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:54.706177 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:54.716021 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:54.717786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:54.719833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-95a17b51-ae09-428c-95d1-887759749c4c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.352144 Nov 03 02:07:54.730557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 466/943] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:54 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:55.738369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:55.739666 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:55.751600 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:55.752108 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:55.752936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:55.753378 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:55.949592 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:55.959355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:55.960936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:55.962127 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b5160c8a-55b6-44fa-86be-c6e8d0ddfb88 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.227756 Nov 03 02:07:55.963098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 478/944] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:55 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:56.878845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-4f8bd898-6a79-41af-8d1e-56508890c0e4 req-62fe5875-b9af-424b-b49c-81379a12e7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "name": "network-vif-plugged", "status": "completed", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:07:56.881337 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:07:56.881337 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:07:56.888975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-4f8bd898-6a79-41af-8d1e-56508890c0e4 req-62fe5875-b9af-424b-b49c-81379a12e7a6 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:56.889772 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-4f8bd898-6a79-41af-8d1e-56508890c0e4 req-62fe5875-b9af-424b-b49c-81379a12e7a6 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:56.908924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-4f8bd898-6a79-41af-8d1e-56508890c0e4 req-62fe5875-b9af-424b-b49c-81379a12e7a6 service nova] Creating event network-vif-plugged:53f57377-fc10-41c9-b2f6-7fbdab22b983 for instance 40c561cb-543d-469c-a637-70cdf610d8a5 on hv-cinder-81561 Nov 03 02:07:56.914947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-4f8bd898-6a79-41af-8d1e-56508890c0e4 req-62fe5875-b9af-424b-b49c-81379a12e7a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314005 Nov 03 02:07:56.916619 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 467/945] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:07:56.982077 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:56.983336 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:56.992931 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:56.993692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:56.994813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:56.996019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:57.266380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:57.275306 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:57.279041 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:57.280534 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-284cc273-f4b6-4d2b-9020-6f76279b0e8c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.303586 Nov 03 02:07:57.282853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 479/946] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:56 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:58.302487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:58.303180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:58.309900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:58.310622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:58.311368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:58.311990 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:58.495378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:58.505416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:58.507420 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:58.509274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8422333c-2353-4fd0-a12c-828a14a2e7f4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.213482 Nov 03 02:07:58.510221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 468/947] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:58 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:07:59.531130 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:07:59.531960 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:07:59.552986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:59.556867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:59.558744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:07:59.560184 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:07:59.826501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:59.834673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:59.836155 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:07:59.837315 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0573cda6-b334-462a-99cc-4b8802c460e9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.310470 Nov 03 02:07:59.837867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 480/948] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:07:59 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:00.857436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:00.858165 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:00.866265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:00.867227 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:00.868334 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:00.869043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:01.071221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:01.081999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:01.094308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:01.094308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2d9a0ec5-6d2b-4094-80e8-f3a683b262bb tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.231811 Nov 03 02:08:01.094308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 469/949] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:00 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:02.104369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:02.105505 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:02.133389 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:02.139566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:02.141211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:02.146061 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:02.650718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:02.662652 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:02.675031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:02.675031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5d3af58c-13fd-4d23-aa32-fd8df5aaf0c5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.565389 Nov 03 02:08:02.679533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 481/950] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:02 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:03.684312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:03.686640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:03.705051 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:03.705513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:03.706351 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:03.706792 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:03.976570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:04.005358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:04.009640 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:04.011157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-48cff2ec-6d7c-4ca2-83da-f84cc6cda852 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.331195 Nov 03 02:08:04.014437 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 470/951] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:03 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:05.034609 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:05.035958 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:05.045363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:05.046182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:05.048121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:05.049160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:05.260157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:05.272446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:05.277392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:05.279892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b9b72d91-9fcc-4497-89ec-b98817af61ba tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.250463 Nov 03 02:08:05.280479 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 482/952] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:05 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:06.298622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:06.299228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:06.314194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:06.319699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:06.320383 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:06.320828 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:06.585478 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:06.600576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:06.604280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:06.604280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e6b46909-28f2-43b5-a37a-6c3a02076e63 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.309590 Nov 03 02:08:06.605429 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 471/953] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:06 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:07.098824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b68e8803-9660-4569-9e60-ed5d429aaf7b tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Action: 'create', calling method: .version_select at 0x7f30b7bb3790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1143971476"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:07.118950 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b68e8803-9660-4569-9e60-ed5d429aaf7b tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for project a08b0f1fc6b940148531ae61a6847288. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:08:07.123152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b68e8803-9660-4569-9e60-ed5d429aaf7b tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for user a9d618d410254d658124e5ee5ae46df2 and project a08b0f1fc6b940148531ae61a6847288. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:08:07.566316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b68e8803-9660-4569-9e60-ed5d429aaf7b tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for project a08b0f1fc6b940148531ae61a6847288. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:08:07.571139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-b68e8803-9660-4569-9e60-ed5d429aaf7b tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for user a9d618d410254d658124e5ee5ae46df2 and project a08b0f1fc6b940148531ae61a6847288. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:08:07.592068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b68e8803-9660-4569-9e60-ed5d429aaf7b tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.764389 Nov 03 02:08:07.592997 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 483/954] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Nov 3 02:08:06 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:07.625701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:07.626480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:07.642626 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:07.644879 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:07.645741 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:07.646260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:07.858276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:07.871866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:07.875964 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:07.878023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8bffe08f-b96d-410a-9336-0ab0eea9b18d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.257724 Nov 03 02:08:07.891243 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 472/955] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:07 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:08.897719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:08.898466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:08.905641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:08.906096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:08.906908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:08.907466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:09.046778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:09.054608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:09.056111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:09.057661 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9b8440da-3dfc-4f38-a2b2-861cb1814e79 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1738 microversion: 2.20 time: 0.163956 Nov 03 02:08:09.058812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 484/956] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:08 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:10.076953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:10.077586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:10.085209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:10.085430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:10.086445 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:10.086924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:10.260311 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:10.269750 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:10.272079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:10.273290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-82a4bf55-959f-4cb0-9076-108770013712 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1720 microversion: 2.20 time: 0.200587 Nov 03 02:08:10.274708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 473/957] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:10 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:08:11.292008 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:11.292574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:11.300122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:11.300603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:11.304314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:11.304314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:11.448658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:11.455291 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:11.456785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:11.457951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f9deca1a-9ef2-4baa-925b-e98df3632027 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1720 microversion: 2.20 time: 0.169703 Nov 03 02:08:11.463478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 485/958] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:11 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:12.475812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:12.476523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:12.482854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:12.485061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:12.485061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:12.485061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:12.532843 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-9b336b89-521c-4831-a167-0f46008213ca req-42a831be-ed34-4257-a32a-a0b81d9423aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "name": "network-vif-unplugged", "status": "completed", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:12.533472 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:08:12.533472 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:08:12.541138 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-9b336b89-521c-4831-a167-0f46008213ca req-42a831be-ed34-4257-a32a-a0b81d9423aa service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:12.541664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-9b336b89-521c-4831-a167-0f46008213ca req-42a831be-ed34-4257-a32a-a0b81d9423aa service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:12.555161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.compute.server_external_events [req-9b336b89-521c-4831-a167-0f46008213ca req-42a831be-ed34-4257-a32a-a0b81d9423aa service nova] Unable to find a host for instance 40c561cb-543d-469c-a637-70cdf610d8a5. Dropping event network-vif-unplugged {{(pid=123012) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 03 02:08:12.556390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-9b336b89-521c-4831-a167-0f46008213ca req-42a831be-ed34-4257-a32a-a0b81d9423aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032456 Nov 03 02:08:12.557936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 486/959] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:08:12 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 03 02:08:12.632831 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:12.641227 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:12.647507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:12.647507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2cf90556-84a1-44f6-8224-a443c5a6bac1 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1663 microversion: 2.20 time: 0.171707 Nov 03 02:08:12.647507 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 474/960] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:12 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1663 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:12.662109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "062fb15f-0e2b-4965-9159-1c32242611b7"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:12.663529 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:12.669791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:12.670480 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:12.671267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:12.671705 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:13.826914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-839b6518-7a6a-402e-8134-ee738d38a338 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.168799 Nov 03 02:08:13.828131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 487/961] 10.222.0.30 () {62 vars in 1363 bytes} [Wed Nov 3 02:08:12 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-volume_attachments => generated 188 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:08:13.942806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:13.943332 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:13.949100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:13.949552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:13.950355 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:13.950791 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:14.535255 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bd752460-4cf4-4460-8826-355d62b70d9a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-volume_attachments/062fb15f-0e2b-4965-9159-1c32242611b7" status: 202 len: 0 microversion: 2.20 time: 0.596068 Nov 03 02:08:14.535884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 475/962] 10.222.0.30 () {60 vars in 1456 bytes} [Wed Nov 3 02:08:13 2021] DELETE /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-volume_attachments/062fb15f-0e2b-4965-9159-1c32242611b7 => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:08:14.592972 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:14.593748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:14.601375 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:14.601820 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:14.602630 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:14.603063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:14.955247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-81d7e169-56e6-4811-9677-6bdf7f893c11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action" status: 202 len: 0 microversion: 2.20 time: 0.366137 Nov 03 02:08:14.955919 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 488/963] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Nov 3 02:08:14 2021] POST /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:08:14.963685 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:14.964313 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:14.971752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:14.972228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:14.972983 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:14.973437 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:15.108675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:15.117160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:15.118677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:15.119819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-097e6339-77ce-486b-8888-68609ccb7499 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.159922 Nov 03 02:08:15.120374 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 476/964] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:14 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:15.496612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:15.497247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:15.504607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:15.505049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:15.505829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:15.506305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:15.532374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lazy-loading 'flavor' on Instance uuid bfcedc8e-ab45-4300-9e60-6e82319256b8 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:08:15.804619 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f9cad3fc-8967-4316-8a11-bb9c8c4f9b95 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "POST /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8/action" status: 202 len: 0 microversion: 2.1 time: 0.311431 Nov 03 02:08:15.805344 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 489/965] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:08:15 2021] POST /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:08:15.815411 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:15.816009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:15.822019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:15.824109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:15.824109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:15.824109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:15.966638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:15.974416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c9a05d34-e7a4-4d3f-9b9a-69b530d3508d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.163502 Nov 03 02:08:15.974975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 477/966] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:15 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:16.138903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:16.139600 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:16.145619 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:16.146069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:16.146873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:16.147308 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:16.282877 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:16.290623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:16.292100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:16.293259 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-81037be9-1619-40d1-8dbe-afe9d8611538 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.158507 Nov 03 02:08:16.293803 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 490/967] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:16 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:16.992907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:16.993513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:16.999813 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:17.000276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:17.001028 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:17.001459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:17.136184 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:17.144156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dc6c3743-9094-4865-9bc0-9f2b670b93fd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.155364 Nov 03 02:08:17.144726 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 478/968] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:16 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:17.312498 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:17.313087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:17.319309 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:17.319760 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:17.320536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:17.320969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:17.461296 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:17.468980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:17.470442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:17.471590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-24c69189-55ba-4722-9db0-00c3b37b4150 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.163343 Nov 03 02:08:17.472158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 491/969] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:17 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:18.161559 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:18.162185 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:18.168274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:18.168709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:18.169457 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:18.169877 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:18.302682 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:18.310987 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fc47ca25-ffd2-4e96-806f-796000c039c9 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.152977 Nov 03 02:08:18.311556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 479/970] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:18 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:18.488659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:18.489345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:18.496082 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:18.496739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:18.497671 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:18.498202 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:18.630725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:18.638605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:18.640673 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:18.641892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-851fdc39-4cfa-4dfe-81d8-7a419435a801 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.157043 Nov 03 02:08:18.642489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 492/971] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:18 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:19.328036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:19.328649 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:19.335491 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:19.336009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:19.336820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:19.337253 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:19.475188 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:19.482450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8eb668bd-1b13-494a-aa87-5be3d78abd22 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.158186 Nov 03 02:08:19.483019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 480/972] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:19 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:19.660986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:19.661590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:19.667842 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:19.668293 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:19.669060 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:19.669489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:19.799616 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:19.808617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:19.810096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:19.811273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7bcebb5c-9bea-4748-8946-ca75d1a64383 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.153978 Nov 03 02:08:19.811863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 493/973] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:19 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:20.499925 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:20.500564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:20.507376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:20.507820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:20.508577 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:20.509000 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:20.642668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:20.650060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e3274de7-e26f-49df-bf1c-6e89b8050976 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.153799 Nov 03 02:08:20.650812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 481/974] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:20 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:20.829051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:20.829583 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:20.835753 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:20.836197 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:20.836962 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:20.837391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:20.969251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:20.977426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:20.978951 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:20.980089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2cc16b5b-6fe7-4469-82d0-930e23543f2d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.154895 Nov 03 02:08:20.980677 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 494/975] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:20 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:21.667554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:21.668161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:21.674513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:21.675032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:21.675813 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:21.676537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:21.809652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:21.817566 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c2d0e444-a61c-4ae9-80e6-5c4746922c37 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.153568 Nov 03 02:08:21.818047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 482/976] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:21 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:21.999207 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:21.999800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:22.008109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:22.008553 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:22.009331 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:22.009759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:22.147794 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:22.155471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:22.156969 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:22.158116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ce522450-d0f1-4d2d-85b1-9bbdff74244d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.162616 Nov 03 02:08:22.166233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 495/977] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:21 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:22.834924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:22.835448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:22.841630 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:22.842077 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:22.842868 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:22.843297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:22.974485 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:22.981684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-540c38a6-06f3-4d11-b128-7a6a172756b4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.150482 Nov 03 02:08:22.982262 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 483/978] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:22 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:23.175801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:23.176382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:23.182948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:23.183392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:23.184161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:23.184722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:23.561111 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:23.569749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:23.571257 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:23.572390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d771acf0-16f3-48e4-81fa-f57e3efa9f11 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.400280 Nov 03 02:08:23.572940 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 496/979] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:23 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:24.000887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:24.001502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:24.008428 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:24.008883 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:24.009860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:24.010250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:24.152045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:24.159930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-55d7fb4e-1b6a-4d1a-a387-aaf7f20146f2 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.162201 Nov 03 02:08:24.160610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 484/980] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:23 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:24.590909 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:24.591518 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:24.597807 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:24.598360 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:24.599131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:24.599561 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:24.733658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:24.741425 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:24.743050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:24.744243 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fcc4e0d4-1028-4990-bd77-a61f7b79f85c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.157110 Nov 03 02:08:24.744847 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 497/981] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:24 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:25.176616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:25.177219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:25.183693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:25.184130 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:25.184916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:25.185343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:25.320623 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:25.327987 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7e46b532-a77b-42db-8ef4-23364cbe260f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.155060 Nov 03 02:08:25.328552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 485/982] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:25 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:25.764106 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:25.764687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:25.771598 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:25.772035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:25.772800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:25.773223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:25.904321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:25.912394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:25.913876 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:25.915038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b58d6600-527f-40de-bcd1-bc827bc8bb8f tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.155968 Nov 03 02:08:25.915591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 498/983] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:25 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:26.349043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:26.350156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:26.357516 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:26.357972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:26.358812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:26.359253 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:26.499647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:26.507727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-24517587-77ca-46ef-96f5-8ed95efa7e77 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.166547 Nov 03 02:08:26.508575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 486/984] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:26 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:26.933826 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:26.934448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:26.940602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:26.941094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:26.941858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:26.942323 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:27.075908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:27.084201 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:27.085763 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:27.086973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2577c36d-0c1b-4552-ace2-d3b7b43d76d9 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.157157 Nov 03 02:08:27.087536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 499/985] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:26 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:27.525265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:27.525820 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:27.532337 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:27.532971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:27.533745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:27.534211 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:27.673251 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:27.680848 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-dbebd3a6-8637-471d-9dde-0992a8a6ff7c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.159223 Nov 03 02:08:27.681422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 487/986] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:27 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:28.106901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:28.108196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:28.116260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:28.116711 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:28.117502 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:28.117933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:28.251285 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:28.261690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:28.263372 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:28.264521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e27b0512-eefa-425c-84db-316c5f01c71e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.161845 Nov 03 02:08:28.265169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 500/987] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:28 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:28.699204 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:28.700601 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:28.708049 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:28.708606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:28.709366 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:28.709824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:28.857804 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:28.865276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-139eb90e-3a4e-4bac-80ba-61e2d6d1d955 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.170086 Nov 03 02:08:28.865831 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 488/988] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:28 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:29.282214 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:29.282892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:29.289150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:29.289640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:29.290528 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:29.290980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:29.436622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:29.444949 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:29.446474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:29.447672 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-85903584-3512-4593-aa94-10a85d10662c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.169099 Nov 03 02:08:29.448238 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 501/989] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:29 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:29.881980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:29.882639 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:29.888817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:29.889268 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:29.890045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:29.890511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.022102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:30.029314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2176e453-5fb7-46a0-9448-0b812bf31033 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1570 microversion: 2.1 time: 0.150973 Nov 03 02:08:30.029886 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 489/990] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:29 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:30.045367 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:30.045928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:30.052142 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.052585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.053351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.053778 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.303420 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2af49389-7d66-4510-8eac-c01450b41c40 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "POST /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8/action" status: 202 len: 0 microversion: 2.1 time: 0.261392 Nov 03 02:08:30.304391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 502/991] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:08:30 2021] POST /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:08:30.312311 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:30.312921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:30.319934 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.320602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.321605 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.322038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.476509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:30.477297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:30.484897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.486410 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.487407 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.488473 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:30.496689 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.509502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-092da151-4f38-4687-ade2-79aa78b512dd tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1518 microversion: 2.1 time: 0.199544 Nov 03 02:08:30.519160 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 490/992] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:30 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:30.633312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-c2b12786-23a2-4b11-baa5-4a09a3207f88 req-eb6994c8-a2e5-4f05-9296-a17403b64e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "name": "network-vif-unplugged", "status": "completed", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:30.635769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:08:30.635769 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:08:30.644330 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-c2b12786-23a2-4b11-baa5-4a09a3207f88 req-eb6994c8-a2e5-4f05-9296-a17403b64e30 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:30.646297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-c2b12786-23a2-4b11-baa5-4a09a3207f88 req-eb6994c8-a2e5-4f05-9296-a17403b64e30 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:30.648385 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:30.656125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:30.656912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.compute.server_external_events [req-c2b12786-23a2-4b11-baa5-4a09a3207f88 req-eb6994c8-a2e5-4f05-9296-a17403b64e30 service nova] Unable to find a host for instance bfcedc8e-ab45-4300-9e60-6e82319256b8. Dropping event network-vif-unplugged {{(pid=123011) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 03 02:08:30.657642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:30.657782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-c2b12786-23a2-4b11-baa5-4a09a3207f88 req-eb6994c8-a2e5-4f05-9296-a17403b64e30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030592 Nov 03 02:08:30.658446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 491/993] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 03 02:08:30.658868 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-335fca5c-d672-441e-8b95-f67eb4a84071 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.197535 Nov 03 02:08:30.663094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 503/994] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:30 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:31.526968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:31.527574 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:31.533274 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:31.533723 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:31.534559 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:31.535018 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:31.675518 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:31.677366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:31.677971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:31.683409 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2c1a892a-84bc-412b-8d15-e444f3d4f944 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1520 microversion: 2.1 time: 0.160828 Nov 03 02:08:31.691674 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 492/995] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:31 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:31.691814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:31.691814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:31.691814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:31.691814 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:31.816779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:31.824406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:31.825924 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:31.827104 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-05d64f1f-84a2-4d37-b7d7-06532209be55 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.154030 Nov 03 02:08:31.827659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 504/996] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:31 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:08:32.701195 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:32.701924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:32.708717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:32.709157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:32.709922 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:32.710372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:32.844795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:32.845719 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:32.853321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:32.854191 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:32.855181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:32.855664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:32.856227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:32.864414 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e96ef86f-6f60-43d3-9be6-563fd38e0a38 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1520 microversion: 2.1 time: 0.166849 Nov 03 02:08:32.865560 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 493/997] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:32 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:32.992991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:33.000624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:33.002213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:33.007404 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-dfe5f744-1002-4a66-ad90-7e474d7bdaae tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.162429 Nov 03 02:08:33.007404 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 505/998] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:32 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:08:33.881505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:33.882115 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:33.888403 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:33.888850 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:33.889649 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:33.890083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:34.022964 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:34.023704 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:34.029276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:34.030514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:34.030963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:34.031746 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:34.032174 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:34.037679 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a6670c64-1f7d-4844-9d30-0cf33ccadb5d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.159886 Nov 03 02:08:34.038363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 494/999] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:33 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:34.172089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:34.179955 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:34.181436 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:34.182854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-93fb9dcb-c8bf-44fc-8ab9-5b06cd4b4400 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1671 microversion: 2.20 time: 0.164324 Nov 03 02:08:34.183433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 506/1000] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:34 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:08:34.691508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1457608290", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1143971476", "security_groups": [{"name": "tempest-secgroup-smoke-2008507579"}], "block_device_mapping_v2": [{"uuid": "62721d1b-1e4d-4358-80bd-f5bfb8649978", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f712cad4-e8ca-42ec-98fb-45f5bacc0fc1"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:34.797236 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] validate_networks() for [('f712cad4-e8ca-42ec-98fb-45f5bacc0fc1', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:08:35.055488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:35.056187 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:35.063524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:35.063966 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:35.064781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:35.065292 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:35.272233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:35.280547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-158cf483-b606-4725-84a4-6d9228f3d337 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.229277 Nov 03 02:08:35.281256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 507/1001] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:35 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:35.285953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:35.286883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:35.292935 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:35.293455 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:35.294351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:35.294879 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:35.298310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:08:35.298785 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:08:35.301218 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:08:35.301830 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:08:35.302498 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:08:35.311430 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:35.311876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:35.312881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:35.313323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:35.331221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for project a08b0f1fc6b940148531ae61a6847288. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:08:35.335586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for user a9d618d410254d658124e5ee5ae46df2 and project a08b0f1fc6b940148531ae61a6847288. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:08:35.396201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:08:35.402502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62721d1b-1e4d-4358-80bd-f5bfb8649978',volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:08:35.444924 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:35.452796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:35.454338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:35.455542 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-56d85af5-dd10-4294-9b5f-ae84e5bc4fea tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.173058 Nov 03 02:08:35.458735 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 508/1002] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:35 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:35.900512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [aad4bd5d-084a-46bc-8d9b-e049848a67a6] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 02:08:36.298470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:36.300897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:36.306295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:36.307147 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:36.307933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:36.308362 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:36.478272 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:36.485912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-41301c8b-4347-4984-99bb-ad9bf3406521 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.191705 Nov 03 02:08:36.490387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 509/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:36 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:36.496262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:36.497202 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:36.506564 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:36.507251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:36.508212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:36.509563 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:36.674722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:36.684102 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:36.685683 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:36.686902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3317ccaa-e7fd-448e-8c1a-29e6f56e09ff tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.195302 Nov 03 02:08:36.697626 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 510/1004] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:36 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:36.917130 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO oslo.messaging._drivers.impl_rabbit [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [aad4bd5d-084a-46bc-8d9b-e049848a67a6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41970. Nov 03 02:08:36.921326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8989d8d6-8175-4546-b78d-84c6ac15c6fe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.234145 Nov 03 02:08:36.922190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 495/1005] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:08:34 2021] POST /compute/v2.1/servers => generated 406 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:08:36.932474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e76656b4-be30-48ed-8319-3406446db0d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:36.933083 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e76656b4-be30-48ed-8319-3406446db0d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:36.993491 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e76656b4-be30-48ed-8319-3406446db0d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:37.000211 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e76656b4-be30-48ed-8319-3406446db0d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1095 microversion: 2.1 time: 0.071660 Nov 03 02:08:37.000780 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 511/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:36 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:37.503735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:37.504351 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:37.510408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:37.510865 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:37.511642 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:37.512081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:37.656505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:37.663760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a021da3e-5c65-4dd5-8602-a7cac7f853d4 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.164115 Nov 03 02:08:37.664433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 496/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:37 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:37.705087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:37.706345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:37.712856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:37.713304 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:37.714088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:37.714551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:37.870481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:37.879722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:37.881260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:37.882494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f043c9bf-3901-4a4c-8341-22276325553c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.181361 Nov 03 02:08:37.883080 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 512/1008] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:37 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:38.017011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8137583a-4ca3-496a-9e3b-256416cf7e5c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:38.017633 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8137583a-4ca3-496a-9e3b-256416cf7e5c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:38.088548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8137583a-4ca3-496a-9e3b-256416cf7e5c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:38.096083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8137583a-4ca3-496a-9e3b-256416cf7e5c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1095 microversion: 2.1 time: 0.083317 Nov 03 02:08:38.097275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 497/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:38 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:38.681893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:38.682525 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:38.688767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:38.689240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:38.690029 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:38.691126 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:38.837634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:38.847537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-06e1378e-d829-42b5-b3b1-b8c381d1a0e1 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.168761 Nov 03 02:08:38.858766 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 513/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:38 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:38.900621 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:38.901227 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:38.908024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:38.908479 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:38.909906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:38.910635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:39.051770 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:39.062079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:39.064833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:39.065172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1cc4adbf-bd52-4091-b1b5-8c0ca32fa29d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.168226 Nov 03 02:08:39.065997 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 498/1011] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:38 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:08:39.113544 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:39.114182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:39.120607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:39.121062 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:39.121979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:39.122660 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:39.189835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:39.197688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-decefdce-7287-476a-a48b-b0c5fe8ae49e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.087910 Nov 03 02:08:39.198440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 514/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:39 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:39.865703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:39.866345 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:39.872101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:39.872579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:39.873335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:39.873759 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:40.015837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:40.023816 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-843f70b9-ded6-448b-8478-98efd3e4e173 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.162478 Nov 03 02:08:40.027167 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 499/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:39 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:40.083828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:40.084459 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:40.090864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:40.091314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:40.092083 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:40.092515 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:40.215897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:40.216553 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:40.223567 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:40.224281 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:40.225110 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:40.225693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:40.229937 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:40.238641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:40.240123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:40.241289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e6cf4369-5498-4efd-8572-ecbdb41f72d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.161295 Nov 03 02:08:40.241903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 515/1014] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:40 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:40.299593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:40.307965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a86ac614-16a5-4b97-b1f7-ea9e0495beee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.095592 Nov 03 02:08:40.308539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 500/1015] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:40 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:41.042529 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:41.043134 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:41.049188 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:41.049636 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:41.050449 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:41.050887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:41.191703 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:41.199094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-42bcdde2-2b31-4997-be8b-e365cfe1084d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.161619 Nov 03 02:08:41.199930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 516/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:41 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:41.262471 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:41.263354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:41.271461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:41.271914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:41.272702 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:41.273142 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:41.324496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:41.325371 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:41.331611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:41.332061 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:41.332855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:41.333511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:41.435314 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:41.445745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c47a0e82-d08b-4a3e-807c-47029268ecdd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.124713 Nov 03 02:08:41.446810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 517/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:41 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:41.478284 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:41.488012 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:41.489513 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:41.490747 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-84beef8b-5473-4336-b540-ba478ed1fdfe tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.233781 Nov 03 02:08:41.491310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 501/1018] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:41 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:42.217247 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:42.217861 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:42.224173 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:42.224864 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:42.225831 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:42.226635 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:42.373758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:42.382270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-13fff1f4-b16b-49f2-9b2e-14e80a29bf49 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.169046 Nov 03 02:08:42.382933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 518/1019] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:42 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:42.462506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:42.463088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:42.469465 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:42.469909 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:42.470710 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:42.471139 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:42.510908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:42.511540 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:42.525750 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:42.529965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:42.531016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:42.531591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:42.548225 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:42.555976 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-63f9eaf2-8bf3-4831-babe-48850aafed9e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.097055 Nov 03 02:08:42.557006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 502/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:42 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:42.690244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:42.698066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:42.699511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:42.700643 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-09c26514-bc2d-4b0a-86ee-0a36d928008a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.193386 Nov 03 02:08:42.701200 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 519/1021] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:42 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:43.401154 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:43.401844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:43.412198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:43.413208 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:43.415924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:43.416558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:43.577068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:43.577992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:43.588024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:43.588693 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:43.595337 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:43.596129 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:43.609725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:43.620172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-232f54de-9c43-4947-9771-b0e390ec1d3a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.222893 Nov 03 02:08:43.620675 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 503/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:43 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:43.675974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:43.693617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c3f6078b-4263-4c22-ae94-a89b106a8f23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.111189 Nov 03 02:08:43.693617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 520/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:43 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:43.719264 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:43.760395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:43.760395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:43.760395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:43.760395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:43.761029 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:43.886598 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:43.895580 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:43.897279 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:43.898714 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8f19b8a9-bb6c-40a4-804c-a29b4acc467a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.184078 Nov 03 02:08:43.899584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 504/1024] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:43 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:44.639421 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:44.640033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:44.647127 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:44.647578 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:44.648375 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:44.648818 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:44.701276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:44.702666 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:44.710695 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:44.711411 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:44.712537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:44.713138 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:44.796523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:44.804255 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-92582ec5-5b6a-4d6a-8752-380f9b05886e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.107069 Nov 03 02:08:44.805151 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 505/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:44 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:44.826031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:44.834244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5a46c7d0-b035-4cf5-b1ed-53b6e7dc2437 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.198449 Nov 03 02:08:44.834812 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 521/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:44 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:44.924732 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:44.925580 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:44.931882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:44.932603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:44.933925 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:44.934540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:45.087526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:45.096036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:45.097911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:45.099314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0f060954-b2cb-4e9c-8f40-9981a6fe88ed tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.178238 Nov 03 02:08:45.100024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 506/1027] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:44 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:45.822865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:45.823496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:45.831974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:45.832460 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:45.833212 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:45.833645 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:45.856210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:45.857584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:45.864684 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:45.865124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:45.865895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:45.866357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:45.897844 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:45.905924 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-85f53938-2752-4982-a820-d0df1c5bb87f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1145 microversion: 2.1 time: 0.087907 Nov 03 02:08:45.906578 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 522/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:45 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:46.011760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:46.020776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fd247b2c-5701-4bd3-8a30-a268eed47894 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.168144 Nov 03 02:08:46.021356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 507/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:45 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:46.118047 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:46.118692 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:46.125196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:46.125686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:46.126547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:46.127018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:46.265798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:46.274546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:46.276331 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:46.277461 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-64b9301b-56ec-4941-bdaf-c82e33b240ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.163553 Nov 03 02:08:46.278063 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 523/1030] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:46 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:46.922021 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:46.922681 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:46.929454 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:46.929899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:46.930699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:46.931129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:46.992564 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:47.000063 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c14c24ba-98c1-44f6-b51c-48c36f9fedf3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1193 microversion: 2.1 time: 0.081735 Nov 03 02:08:47.000633 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 508/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:46 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:47.038508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:47.039118 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:47.045537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:47.045980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:47.046800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:47.047227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:47.181622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:47.188831 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b09fbcaf-ab3f-4f1d-b9f4-51b237ea3044 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.154698 Nov 03 02:08:47.189394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 524/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:47 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:47.295246 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:47.295849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:47.301663 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:47.302098 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:47.302896 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:47.303323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:47.429910 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:47.437733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:47.439235 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:47.440363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a5b18465-a2dd-4f46-89ac-4d65da2e2bd2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.148914 Nov 03 02:08:47.440917 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 509/1033] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:47 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:48.016507 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:48.017117 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:48.023572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:48.024015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:48.024781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:48.025216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:48.086641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:48.093822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-02c90796-996c-4df3-8056-3ab3e24644c9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1193 microversion: 2.1 time: 0.080910 Nov 03 02:08:48.094416 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 525/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:48 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:48.205501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:48.206102 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:48.212413 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:48.212860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:48.213613 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:48.214038 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:48.344833 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:48.352533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7d861e6f-3ef4-4f23-aaf2-fbf6d665c8b6 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.150596 Nov 03 02:08:48.353122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 510/1035] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:48 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:48.462858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:48.463412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:48.469219 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:48.469667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:48.470471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:48.470906 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:48.598975 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:48.606579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:48.608068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:48.609240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ed32038b-304e-43ce-8eac-758913a88f30 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.154702 Nov 03 02:08:48.609800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 526/1036] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:48 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:49.109774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:49.110525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:49.116752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:49.117193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:49.117953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:49.118412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:49.180677 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:49.188031 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-035e7e1d-1568-40a7-a8ae-544e89973e9c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1193 microversion: 2.1 time: 0.081922 Nov 03 02:08:49.188596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 511/1037] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:49 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:49.369785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:49.370419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:49.376611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:49.377062 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:49.377835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:49.378311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:49.506949 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:49.514098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1d7a1c92-e3dc-47ed-a809-590a5f99c29b tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.148022 Nov 03 02:08:49.514689 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 527/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:49 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:49.627011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:49.627635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:49.633758 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:49.634231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:49.634995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:49.635421 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:49.762128 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:49.770527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:49.772012 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:49.773189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-adc37d27-0183-4ac9-b0ad-bc16593b14ad tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.149870 Nov 03 02:08:49.773755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 512/1039] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:49 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 02:08:50.205193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:50.205805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:50.213413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:50.213863 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:50.214665 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:50.215099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:50.279585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:50.288957 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-db6e2964-4405-4946-a341-467fd870be8a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1201 microversion: 2.1 time: 0.088104 Nov 03 02:08:50.289901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 528/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:50 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:50.531401 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:50.532150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:50.537801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:50.538282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:50.539095 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:50.539531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:50.678638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:50.686410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-937b51e1-4bc7-46fb-b508-e07a83ae4b8c tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.158588 Nov 03 02:08:50.686980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 513/1041] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:50 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:50.792015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:50.793395 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:50.799933 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:50.801087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:50.801926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:50.802387 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:50.951512 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:50.959947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:50.961698 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:50.962909 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-eb5e79e8-74a5-4993-8b57-86ab206e0da4 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.174891 Nov 03 02:08:50.963511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 529/1042] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:50 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:51.306793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:51.307402 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:51.313487 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:51.313929 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:51.314721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:51.315146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:51.383737 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:51.391098 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6cb66e70-81f1-4b4e-96c9-56ddcc92a883 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1211 microversion: 2.1 time: 0.088262 Nov 03 02:08:51.391656 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 514/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:51 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:51.703263 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:51.703875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:51.710371 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:51.710818 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:51.711586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:51.712017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:51.849701 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:51.856973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-df741ce4-6631-4054-bb0d-751f9ea87777 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.157407 Nov 03 02:08:51.857576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 530/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:51 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:51.983322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:51.984187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:51.990774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:51.991228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:51.992009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:51.992443 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:52.135542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:52.143324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:52.144870 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:52.146011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-bc1284e0-2a94-436d-adf0-8ccdcec54b36 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.166445 Nov 03 02:08:52.146770 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 515/1045] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:51 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:52.411349 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:52.411966 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:52.418493 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:52.419018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:52.419810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:52.420430 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:52.568172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:52.575533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8e12bdf8-5d1d-4bf2-bc1e-7374bbb2307a tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1279 microversion: 2.1 time: 0.168465 Nov 03 02:08:52.576107 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 531/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:52 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:52.874481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:52.875081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:52.880792 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:52.886040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:52.886040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:52.886040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.015397 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:53.021845 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-e1681369-fecb-408b-95bd-eb417fd4865d req-0e467f78-2494-4e83-b2d9-6ac7075a58db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac3d5d-bfe6-4665-a05e-4e43603bdeea", "tag": "965fb444-aa57-4bbf-bf8d-51156d65ecb3"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:53.023563 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:08:53.023563 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:08:53.026247 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fdccfbdd-7464-43e9-8374-9a4cc4cc4879 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.155295 Nov 03 02:08:53.026864 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 516/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:52 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:53.041686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e1681369-fecb-408b-95bd-eb417fd4865d req-0e467f78-2494-4e83-b2d9-6ac7075a58db service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:53.042233 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e1681369-fecb-408b-95bd-eb417fd4865d req-0e467f78-2494-4e83-b2d9-6ac7075a58db service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.053788 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-e1681369-fecb-408b-95bd-eb417fd4865d req-0e467f78-2494-4e83-b2d9-6ac7075a58db service nova] Creating event network-changed:965fb444-aa57-4bbf-bf8d-51156d65ecb3 for instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea on hv-cinder-81561 Nov 03 02:08:53.059340 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-e1681369-fecb-408b-95bd-eb417fd4865d req-0e467f78-2494-4e83-b2d9-6ac7075a58db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041651 Nov 03 02:08:53.060048 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 532/1048] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:08:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:08:53.166998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:53.168270 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:53.175498 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:53.175944 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.176716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:53.177145 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.309316 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:53.317893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:53.319389 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:53.320523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8320e961-7ba7-4de5-9274-2fa57d0eee41 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.159642 Nov 03 02:08:53.321080 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 517/1049] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:53 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:53.592752 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:53.593450 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:53.599369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:53.599816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.600587 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:53.601019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.702472 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-ce97bb2b-e198-4aaa-bc47-bfffbdcd03a1 req-5b338911-73a4-42d7-8d9d-59f9780b2693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "name": "network-vif-plugged", "status": "completed", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:53.704103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:08:53.704103 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:08:53.711166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-ce97bb2b-e198-4aaa-bc47-bfffbdcd03a1 req-5b338911-73a4-42d7-8d9d-59f9780b2693 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:53.711714 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-ce97bb2b-e198-4aaa-bc47-bfffbdcd03a1 req-5b338911-73a4-42d7-8d9d-59f9780b2693 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:53.723240 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-ce97bb2b-e198-4aaa-bc47-bfffbdcd03a1 req-5b338911-73a4-42d7-8d9d-59f9780b2693 service nova] Creating event network-vif-plugged:9fede95c-7a4c-431b-802a-bfb045b4ba84 for instance bfcedc8e-ab45-4300-9e60-6e82319256b8 on hv-cinder-81561 Nov 03 02:08:53.728377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-ce97bb2b-e198-4aaa-bc47-bfffbdcd03a1 req-5b338911-73a4-42d7-8d9d-59f9780b2693 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030003 Nov 03 02:08:53.728969 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 518/1050] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:08:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:08:53.735324 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:53.743396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5c5b6d6b-1e32-482c-92aa-dd4351484be0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.154672 Nov 03 02:08:53.744918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 533/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:53 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:54.044178 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:54.044882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:54.050956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:54.059116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:54.059116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:54.059116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:54.185368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:54.191985 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6d3a1750-64a5-4508-b7c0-940fb56ecece tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.152271 Nov 03 02:08:54.192554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 519/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:54 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:08:54.338123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:54.338752 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:54.344891 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:54.345335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:54.346094 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:54.346560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:54.478433 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:54.486142 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:54.488677 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:54.489825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d615d02c-da74-4bd4-baad-4b7d3c82a473 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.155373 Nov 03 02:08:54.490417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 534/1053] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:54 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:54.761112 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:54.761664 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:54.767528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:54.768031 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:54.768795 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:54.769223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:54.898502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:54.905753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0a1f4f8e-0b8c-4abc-aaa3-c7df905e0a80 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.148411 Nov 03 02:08:54.906355 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 520/1054] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:54 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:55.209245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:55.209850 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:55.215704 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.216145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:55.216901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.217327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:55.350091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:55.357451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7a3d8976-5e72-4d3c-96dd-bdfad096987d tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.151893 Nov 03 02:08:55.358016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 535/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:55 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:55.510315 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:55.510315 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:55.515633 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.516079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:55.516851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.517283 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:55.684629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:55.693471 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:55.695146 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:55.696968 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f5bd2f0e-18ae-4c7e-bb68-ad00428154ec tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.192193 Nov 03 02:08:55.697521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 521/1056] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:55 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:55.744158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-c43fafe2-fb93-4fc3-93fd-3674c482974c req-528bdb03-1f9f-446c-9903-39254922074d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "name": "network-vif-plugged", "status": "completed", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:08:55.745781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:08:55.745781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:08:55.753213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-c43fafe2-fb93-4fc3-93fd-3674c482974c req-528bdb03-1f9f-446c-9903-39254922074d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.753658 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-c43fafe2-fb93-4fc3-93fd-3674c482974c req-528bdb03-1f9f-446c-9903-39254922074d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:55.770614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-c43fafe2-fb93-4fc3-93fd-3674c482974c req-528bdb03-1f9f-446c-9903-39254922074d service nova] Creating event network-vif-plugged:53f57377-fc10-41c9-b2f6-7fbdab22b983 for instance 40c561cb-543d-469c-a637-70cdf610d8a5 on hv-cinder-81561 Nov 03 02:08:55.770614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-c43fafe2-fb93-4fc3-93fd-3674c482974c req-528bdb03-1f9f-446c-9903-39254922074d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029321 Nov 03 02:08:55.770614 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 536/1057] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:08:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:08:55.922087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:55.922720 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:55.928485 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.928921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:55.929674 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:55.930101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:56.067529 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:56.076222 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7ecd92dc-4097-4048-896f-0dc306d32a23 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.157134 Nov 03 02:08:56.076993 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 522/1058] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:55 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:56.375470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:56.376176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:56.383402 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:56.383938 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:56.384732 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:56.385158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:56.519313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:56.526607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8794aacb-ecd5-4eed-b3d5-a765fc296d14 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1576 microversion: 2.1 time: 0.155148 Nov 03 02:08:56.527177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 537/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:56 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:56.715706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:56.716418 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:56.722570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:56.723563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:56.724326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:56.724752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:56.861987 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:56.869896 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:56.871495 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:56.872634 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d817d9a6-6ed0-4896-a6a5-aa8a1075b1ce tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.160644 Nov 03 02:08:56.873197 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 523/1060] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:56 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:57.093241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:57.093957 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:57.099758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:57.100204 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:57.100975 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:57.101401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:57.240971 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:57.248074 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-42d87508-1da1-48a2-bede-4b0f75fe73b2 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.158605 Nov 03 02:08:57.248630 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 538/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:57 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:57.543467 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:57.543998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:57.549914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:57.550408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:57.551817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:57.552262 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:57.680328 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:57.687882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c6e39a0d-c3a6-4307-99a4-c32ad45fc621 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1563 microversion: 2.1 time: 0.148192 Nov 03 02:08:57.688449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 524/1062] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:57 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:57.890633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:57.891231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:57.897928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:57.898388 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:57.899152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:57.899576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:58.025490 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:58.033051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:58.034552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:58.036235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-99cadc3d-4a35-4807-abb2-a373be077c70 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.148646 Nov 03 02:08:58.036784 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 539/1063] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:57 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:58.265380 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:58.266205 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:58.275898 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:58.276337 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:58.277122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:58.277552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:58.420451 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:58.427935 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-afb0e46c-d0de-47a4-940b-88e6e4db1eac tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.166332 Nov 03 02:08:58.428436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 525/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:58 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:08:59.054058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:59.054624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:59.061125 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:59.061570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:59.062401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:59.062830 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:59.190033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:59.198168 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:59.199690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:59.200825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-daacd1ff-066a-4a01-842c-f20b54e6744a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.150588 Nov 03 02:08:59.201382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 540/1065] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:08:59 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:08:59.445953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:08:59.446583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:08:59.452786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:59.453234 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:59.453995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:08:59.454461 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:08:59.588459 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:08:59.595603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fe29699a-4702-40dd-837c-8f4395df9ca1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.153894 Nov 03 02:08:59.596162 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 526/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:08:59 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:00.219544 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:00.220152 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:00.227040 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:00.227486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:00.228352 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:00.228780 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:00.358659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:00.367616 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:00.371200 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:00.371200 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a3d115e7-7120-4713-8b76-094b976e4dc6 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.154367 Nov 03 02:09:00.371200 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 541/1067] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:00 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:09:00.611835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:00.612653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:00.618775 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:00.620199 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:00.620199 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:00.620455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:00.752548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:00.760462 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-18ae20c0-a33b-41e0-8eaa-79fd0167ae37 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.152182 Nov 03 02:09:00.761138 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 527/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:00 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:01.388585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:01.395076 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:01.395505 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:01.395752 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:01.396516 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:01.396942 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:01.544981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:01.551504 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:01.553006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:01.559146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6a79a9fd-a56b-4fe4-80dd-b7a37ef33a2b tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1729 microversion: 2.20 time: 0.169417 Nov 03 02:09:01.559146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 542/1069] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:01 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:09:01.776753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:01.777357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:01.783518 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:01.783966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:01.784739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:01.785175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:01.921895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:01.929122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-89095de2-494c-4435-a698-d8298f87066c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.155956 Nov 03 02:09:01.929682 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 528/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:01 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:02.576446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:02.577079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:02.583287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:02.583729 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:02.584524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:02.584953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:02.720055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:02.728199 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:02.729669 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:02.730851 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-181cffa9-de82-4cee-b507-1f36e52358d2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1716 microversion: 2.20 time: 0.158096 Nov 03 02:09:02.731437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 543/1071] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:02 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:09:02.945653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:02.946309 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:02.952359 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:02.952798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:02.953554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:02.953980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:03.082632 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:03.090568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0762fe50-71a2-4978-9799-3c469ffa7ad3 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.148474 Nov 03 02:09:03.091130 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 529/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:02 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:04.107379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:04.108078 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:04.114442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:04.122736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:04.122736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:04.122736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:04.326303 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:04.333597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1845253a-4654-41c3-9fdd-a49f93957fcf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.229739 Nov 03 02:09:04.334103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 544/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:04 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:05.349936 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:05.350591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:05.356696 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:05.357142 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:05.357941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:05.358391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:05.487473 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:05.495244 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9512a9ee-b7e7-476e-a61d-1894512ce970 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.148993 Nov 03 02:09:05.495814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 530/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:05 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:06.512196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:06.512761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:06.518700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:06.519976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:06.519976 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:06.520356 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:06.663852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:06.671390 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5b2948d5-42ea-4174-88c3-0601dc32c981 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.162901 Nov 03 02:09:06.672016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 545/1075] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:06 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:07.689522 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:07.690079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-7b2ad7a2-d606-41a9-9fa0-62dea78237be req-e65a497c-6e24-4087-b6c5-c26d410b0490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac3d5d-bfe6-4665-a05e-4e43603bdeea", "name": "network-vif-plugged", "status": "completed", "tag": "965fb444-aa57-4bbf-bf8d-51156d65ecb3"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:09:07.692084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:09:07.692084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:09:07.692729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:07.703972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:07.703972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:07.703972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:07.703972 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:07.704952 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-7b2ad7a2-d606-41a9-9fa0-62dea78237be req-e65a497c-6e24-4087-b6c5-c26d410b0490 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:07.705591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-7b2ad7a2-d606-41a9-9fa0-62dea78237be req-e65a497c-6e24-4087-b6c5-c26d410b0490 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:07.718828 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-7b2ad7a2-d606-41a9-9fa0-62dea78237be req-e65a497c-6e24-4087-b6c5-c26d410b0490 service nova] Creating event network-vif-plugged:965fb444-aa57-4bbf-bf8d-51156d65ecb3 for instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea on hv-cinder-81561 Nov 03 02:09:07.724703 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-7b2ad7a2-d606-41a9-9fa0-62dea78237be req-e65a497c-6e24-4087-b6c5-c26d410b0490 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039139 Nov 03 02:09:07.725403 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 546/1076] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:09:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:09:07.845991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:07.853971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6c910997-02ea-4404-a943-f823f0ba8ae9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.168916 Nov 03 02:09:07.855096 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 531/1077] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:07 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:08.871792 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:08.872479 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:08.878471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:08.878910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:08.879671 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:08.880099 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:09.009141 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:09.016359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ead29528-d3d4-4f9b-8eba-22c3812443cd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1267 microversion: 2.1 time: 0.148946 Nov 03 02:09:09.016923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 547/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:08 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:10.032458 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:10.033053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:10.039903 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:10.040342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:10.041101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:10.041526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:10.171644 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:10.178858 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-99833226-1a3c-447d-b8bf-77468f6105d9 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1453 microversion: 2.1 time: 0.150010 Nov 03 02:09:10.179455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 532/1079] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:10 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:10.197763 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:10.198409 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:10.204701 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:10.205149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:10.205920 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:10.206382 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:10.333350 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:10.340571 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-7f2b6218-4b41-4c2d-9929-dff1824b7c07 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1453 microversion: 2.1 time: 0.147047 Nov 03 02:09:10.341134 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 548/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:10 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:12.650302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-adc6e55a-cb4f-4a1a-b2fd-de18785f656f req-d8deb139-ed1f-4d0b-9c24-aa582a822d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac3d5d-bfe6-4665-a05e-4e43603bdeea", "tag": "965fb444-aa57-4bbf-bf8d-51156d65ecb3"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:09:12.652111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:09:12.652111 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:09:12.659203 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-adc6e55a-cb4f-4a1a-b2fd-de18785f656f req-d8deb139-ed1f-4d0b-9c24-aa582a822d4c service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:12.659647 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-adc6e55a-cb4f-4a1a-b2fd-de18785f656f req-d8deb139-ed1f-4d0b-9c24-aa582a822d4c service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:12.672729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-adc6e55a-cb4f-4a1a-b2fd-de18785f656f req-d8deb139-ed1f-4d0b-9c24-aa582a822d4c service nova] Creating event network-changed:965fb444-aa57-4bbf-bf8d-51156d65ecb3 for instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea on hv-cinder-81561 Nov 03 02:09:12.677709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-adc6e55a-cb4f-4a1a-b2fd-de18785f656f req-d8deb139-ed1f-4d0b-9c24-aa582a822d4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030912 Nov 03 02:09:12.678342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 533/1081] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:09:35.823686 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:35.824547 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:35.830406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:35.830844 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:35.831601 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:35.832028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:35.859736 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c817d6a8-7dc4-4887-8fda-b7255db16d6d tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040102 Nov 03 02:09:35.860280 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 549/1082] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Nov 3 02:09:35 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:09:35.916058 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:35.916699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:35.922683 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:35.923119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:35.923882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:35.924313 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:35.949054 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:09:36.260655 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-77e7ed25-0919-4f1b-b9ce-ff9f9ac8810a tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 204 len: 0 microversion: 2.20 time: 0.349399 Nov 03 02:09:36.261273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 534/1083] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Nov 3 02:09:35 2021] DELETE /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 02:09:36.269027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:36.278918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:36.278918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:36.278918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:36.278918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:36.279322 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:36.407013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:36.414500 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:36.415978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:36.417105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5b0d74ae-0bfc-473f-87a3-068c2ea17f06 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.151740 Nov 03 02:09:36.417660 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 550/1084] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:36 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:09:37.435824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:37.436515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:37.442744 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:37.443190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:37.444521 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:37.444952 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:37.576800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:37.584523 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:37.586024 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:37.587215 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-77ef5cf8-b896-4d5f-9fc3-e5ba2c3f1bac tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1722 microversion: 2.20 time: 0.155456 Nov 03 02:09:37.587780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 535/1085] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:37 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:09:38.604551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:38.605163 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:38.611414 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:38.611858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:38.612624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:38.613053 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:38.680577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:38.688509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:38.690015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5de27df6f294e9f9c40f6b14315a228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86777c3ab41c4ea8bbbdf156c7792513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:38.691260 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-37c0888b-884e-430a-bb0f-595fdbb4f02c tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 200 len: 1656 microversion: 2.20 time: 0.090367 Nov 03 02:09:38.691822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 551/1086] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:38 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 02:09:38.735363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-f846db7d-8007-49e0-a8dd-6b2ff226dd2a req-ad5d9fce-b6d6-4dbe-b601-1810a07c9bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c561cb-543d-469c-a637-70cdf610d8a5", "name": "network-vif-deleted", "tag": "53f57377-fc10-41c9-b2f6-7fbdab22b983"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:09:38.736960 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:09:38.736960 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:09:38.744376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f846db7d-8007-49e0-a8dd-6b2ff226dd2a req-ad5d9fce-b6d6-4dbe-b601-1810a07c9bdc service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:38.744817 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f846db7d-8007-49e0-a8dd-6b2ff226dd2a req-ad5d9fce-b6d6-4dbe-b601-1810a07c9bdc service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:38.762901 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-f846db7d-8007-49e0-a8dd-6b2ff226dd2a req-ad5d9fce-b6d6-4dbe-b601-1810a07c9bdc service nova] Creating event network-vif-deleted:53f57377-fc10-41c9-b2f6-7fbdab22b983 for instance 40c561cb-543d-469c-a637-70cdf610d8a5 on hv-cinder-81561 Nov 03 02:09:38.764743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-f846db7d-8007-49e0-a8dd-6b2ff226dd2a req-ad5d9fce-b6d6-4dbe-b601-1810a07c9bdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032944 Nov 03 02:09:38.765345 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 536/1087] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:09:39.709105 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:39.709712 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:39.716015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:39.717183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:39.717298 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:39.717646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:39.730574 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] HTTP exception thrown: Instance 40c561cb-543d-469c-a637-70cdf610d8a5 could not be found. Nov 03 02:09:39.731154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Returning 404 to user: Instance 40c561cb-543d-469c-a637-70cdf610d8a5 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:09:39.731963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d8366e05-9af6-49aa-9737-1c9fa035a381 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 404 len: 111 microversion: 2.20 time: 0.026608 Nov 03 02:09:39.732487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 552/1088] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Nov 3 02:09:39 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 02:09:39.741596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5d66e59b-c83c-42a4-8963-b7837c0c0a27 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '.version_select at 0x7f30c44b08b0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:39.844335 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5d66e59b-c83c-42a4-8963-b7837c0c0a27 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335730212" status: 204 len: 0 microversion: 2.20 time: 0.107155 Nov 03 02:09:39.848846 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 537/1089] 10.222.0.30 () {60 vars in 1261 bytes} [Wed Nov 3 02:09:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335730212 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 02:09:42.096191 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:42.096702 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:42.103130 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:42.103570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:42.104334 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:42.104764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:42.117484 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] HTTP exception thrown: Instance 40c561cb-543d-469c-a637-70cdf610d8a5 could not be found. Nov 03 02:09:42.118065 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Returning 404 to user: Instance 40c561cb-543d-469c-a637-70cdf610d8a5 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:09:42.118908 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-27e62b4c-66a9-4999-97e2-e7d2db4d3c4e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 404 len: 111 microversion: 2.1 time: 0.026370 Nov 03 02:09:42.119420 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 553/1090] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:09:42 2021] DELETE /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:09:42.127536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:42.131945 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: 40c561cb-543d-469c-a637-70cdf610d8a5] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:42.134588 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:42.135052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:42.135801 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:42.137946 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:42.151194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] HTTP exception thrown: Instance 40c561cb-543d-469c-a637-70cdf610d8a5 could not be found. Nov 03 02:09:42.151765 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Returning 404 to user: Instance 40c561cb-543d-469c-a637-70cdf610d8a5 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:09:42.152571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-73e7c71d-086f-4903-8ff5-99e3c50e74a2 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5" status: 404 len: 111 microversion: 2.1 time: 0.029394 Nov 03 02:09:42.153091 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 538/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:42 2021] GET /compute/v2.1/servers/40c561cb-543d-469c-a637-70cdf610d8a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:09:43.489902 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:43.490911 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:43.497041 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:43.497486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:43.498270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:43.498701 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:43.512066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] HTTP exception thrown: Instance c1203383-0300-4df4-8d34-0d52ac57e83d could not be found. Nov 03 02:09:43.512625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Returning 404 to user: Instance c1203383-0300-4df4-8d34-0d52ac57e83d could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:09:43.513417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2757b58b-308b-44ea-8341-0ff3137e2f6e tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 404 len: 111 microversion: 2.1 time: 0.027236 Nov 03 02:09:43.513922 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 554/1092] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:09:43 2021] DELETE /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:09:43.521504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:43.522115 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] [instance: c1203383-0300-4df4-8d34-0d52ac57e83d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:43.527835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:43.528275 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:43.529046 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:43.529477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:43.542129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] HTTP exception thrown: Instance c1203383-0300-4df4-8d34-0d52ac57e83d could not be found. Nov 03 02:09:43.542745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] Returning 404 to user: Instance c1203383-0300-4df4-8d34-0d52ac57e83d could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:09:43.543552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9f34828b-17c5-448b-bc90-4bbbb37bc2d5 tempest-AttachVolumeShelveTestJSON-2060537660 tempest-AttachVolumeShelveTestJSON-2060537660-project] 10.222.0.30 "GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d" status: 404 len: 111 microversion: 2.1 time: 0.025848 Nov 03 02:09:43.544079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 539/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:43 2021] GET /compute/v2.1/servers/c1203383-0300-4df4-8d34-0d52ac57e83d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:09:54.667413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-395efae8-025a-4a56-9fa5-236f50d45e7f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: .version_select at 0x7f30b7ba23a0>, body: {"keypair": {"name": "tempest-keypair-1883806535"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:09:54.684856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-395efae8-025a-4a56-9fa5-236f50d45e7f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:09:54.688545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-395efae8-025a-4a56-9fa5-236f50d45e7f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for user 2dd4afe870ee4c5e88b2fc94035eb855 and project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:09:55.034074 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-395efae8-025a-4a56-9fa5-236f50d45e7f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:09:55.040861 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-395efae8-025a-4a56-9fa5-236f50d45e7f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for user 2dd4afe870ee4c5e88b2fc94035eb855 and project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:09:55.051647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-395efae8-025a-4a56-9fa5-236f50d45e7f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.503785 Nov 03 02:09:55.052910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 555/1094] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Nov 3 02:09:54 2021] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:09:57.384827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-631461529", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cffa4a5f-809a-4e6a-b540-236a07565506"}], "security_groups": [{"name": "tempest-securitygroup--9456794"}], "key_name": "tempest-keypair-1883806535", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:09:57.496134 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] validate_networks() for [('cffa4a5f-809a-4e6a-b540-236a07565506', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:09:57.879835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:09:57.881002 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:09:57.881551 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:09:57.882026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:09:57.882658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:09:57.891568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:57.892009 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:57.892866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:09:57.893489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:09:57.909894 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for project acd183c43fe64f528cb1a54e0e951443. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:09:57.913864 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for user 2dd4afe870ee4c5e88b2fc94035eb855 and project acd183c43fe64f528cb1a54e0e951443. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:09:57.924693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:09:57.927574 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:09:58.078645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-92debe78-3b65-4664-a838-eba479434790 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.698478 Nov 03 02:09:58.079543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 540/1095] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:09:57 2021] POST /compute/v2.1/servers => generated 399 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:09:58.090766 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0e31f508-24da-44dd-90b2-f5b103ab9b4f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:58.091481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0e31f508-24da-44dd-90b2-f5b103ab9b4f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:58.156130 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0e31f508-24da-44dd-90b2-f5b103ab9b4f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:58.164020 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0e31f508-24da-44dd-90b2-f5b103ab9b4f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1237 microversion: 2.1 time: 0.077177 Nov 03 02:09:58.164634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 556/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:58 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:09:59.181930 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0b2d08ad-52c7-4ae4-b2cd-cd414197fbae tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:09:59.182597 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0b2d08ad-52c7-4ae4-b2cd-cd414197fbae tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:09:59.233835 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0b2d08ad-52c7-4ae4-b2cd-cd414197fbae tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:09:59.241583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0b2d08ad-52c7-4ae4-b2cd-cd414197fbae tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1237 microversion: 2.1 time: 0.064594 Nov 03 02:09:59.242165 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 541/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:09:59 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:10:00.258982 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:00.259593 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:00.265866 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:00.266367 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:00.267134 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:00.267566 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:00.326046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:00.334733 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d76dc56a-eee4-41f3-ba51-162e304cf34a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1289 microversion: 2.1 time: 0.079987 Nov 03 02:10:00.335295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 557/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:00 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:01.350965 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:01.351572 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:01.357913 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:01.358398 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:01.359187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:01.359810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:01.565853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:01.573750 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c07d4656-fe10-4333-bc02-0030447b4e40 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.226368 Nov 03 02:10:01.574338 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 542/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:01 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:02.258567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-b4448ecc-09ad-4b2f-814e-74e781351551 req-81d17261-b700-4da7-a40b-c72e631a8907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f31bdf-2f02-4be5-b437-7e26dcceb512", "tag": "3f82229d-ed31-4b55-ac47-c7a8393800cd"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:02.260193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:10:02.260193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:10:02.269883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-b4448ecc-09ad-4b2f-814e-74e781351551 req-81d17261-b700-4da7-a40b-c72e631a8907 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:02.270432 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-b4448ecc-09ad-4b2f-814e-74e781351551 req-81d17261-b700-4da7-a40b-c72e631a8907 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:02.294801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-b4448ecc-09ad-4b2f-814e-74e781351551 req-81d17261-b700-4da7-a40b-c72e631a8907 service nova] Creating event network-changed:3f82229d-ed31-4b55-ac47-c7a8393800cd for instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 on hv-cinder-81561 Nov 03 02:10:02.300727 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-b4448ecc-09ad-4b2f-814e-74e781351551 req-81d17261-b700-4da7-a40b-c72e631a8907 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047550 Nov 03 02:10:02.301961 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 558/1100] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:10:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:02.591023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:02.591625 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:02.598072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:02.598549 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:02.599349 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:02.599778 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:02.811980 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:02.819590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d630c7e2-64ef-4fd7-a55e-64346d7c6409 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.232405 Nov 03 02:10:02.820152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 543/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:02 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:03.837175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:03.837789 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:03.844172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:03.844611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:03.845370 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:03.845797 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:03.974779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:03.981447 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1d21eea4-ccef-483a-b690-a5372245ac5a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.148813 Nov 03 02:10:03.982014 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 559/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:03 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:04.998189 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:04.998802 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:05.005043 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:05.005489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:05.006293 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:05.006729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:05.142616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:05.150213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-31bb82f7-ed33-4786-a5be-238320e86e8c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.155708 Nov 03 02:10:05.150776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 544/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:04 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:06.166372 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:06.166985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:06.173325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:06.173771 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:06.174578 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:06.175011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:06.401539 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:06.408801 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6a9870bf-b848-4404-92b1-2fae0aaba09f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.246023 Nov 03 02:10:06.409305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 560/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:06 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:07.425701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:07.426326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:07.433258 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:07.433701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:07.434515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:07.434941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:07.565720 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:07.573515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-09d00499-83da-4f22-a627-292539c1f37c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.151476 Nov 03 02:10:07.574078 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 545/1105] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:07 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:07.993929 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-eb309219-2159-4828-9959-b3bdd0ac5aa6 req-373a00c5-5dd2-43fe-9394-a1f4e957b2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f31bdf-2f02-4be5-b437-7e26dcceb512", "name": "network-vif-plugged", "status": "completed", "tag": "3f82229d-ed31-4b55-ac47-c7a8393800cd"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:07.995468 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:10:07.995468 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:10:08.003627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-eb309219-2159-4828-9959-b3bdd0ac5aa6 req-373a00c5-5dd2-43fe-9394-a1f4e957b2df service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:08.004022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-eb309219-2159-4828-9959-b3bdd0ac5aa6 req-373a00c5-5dd2-43fe-9394-a1f4e957b2df service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:08.014507 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-eb309219-2159-4828-9959-b3bdd0ac5aa6 req-373a00c5-5dd2-43fe-9394-a1f4e957b2df service nova] Creating event network-vif-plugged:3f82229d-ed31-4b55-ac47-c7a8393800cd for instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 on hv-cinder-81561 Nov 03 02:10:08.019408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-eb309219-2159-4828-9959-b3bdd0ac5aa6 req-373a00c5-5dd2-43fe-9394-a1f4e957b2df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029194 Nov 03 02:10:08.020058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 561/1106] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:10:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:08.590555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:08.591186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:08.597609 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:08.598081 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:08.598876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:08.599312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:08.727679 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:08.734782 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cbedb65c-e43d-49e5-8088-761d071d26a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1360 microversion: 2.1 time: 0.147903 Nov 03 02:10:08.735342 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 546/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:08 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:09.751804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:09.752487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:09.758948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:09.759386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:09.760156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:09.760581 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:09.911509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:09.918690 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ef79434f-5c28-4b20-b4f6-08e05715a4e1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1545 microversion: 2.1 time: 0.170913 Nov 03 02:10:09.919256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 562/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:09 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:09.935356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:09.935851 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:09.942035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:09.942547 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:09.943320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:09.943753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:10.024958 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-85af9cc1-f2b8-4aba-ab60-0b323ab0f4bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093189 Nov 03 02:10:10.025552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 547/1109] 10.222.0.30 () {58 vars in 1274 bytes} [Wed Nov 3 02:10:09 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:10.993096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:10.994013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:11.000644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:11.001084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:11.001917 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:11.002032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-4b50db7b-68f7-47e2-8e29-2b765d5c1c57 req-c7e74d1c-2d92-4aa5-ab8b-102e797e9f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f31bdf-2f02-4be5-b437-7e26dcceb512", "tag": "3f82229d-ed31-4b55-ac47-c7a8393800cd"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:11.002451 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:11.003659 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:10:11.003659 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:10:11.010983 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-4b50db7b-68f7-47e2-8e29-2b765d5c1c57 req-c7e74d1c-2d92-4aa5-ab8b-102e797e9f80 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:11.011424 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-4b50db7b-68f7-47e2-8e29-2b765d5c1c57 req-c7e74d1c-2d92-4aa5-ab8b-102e797e9f80 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:11.022730 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-4b50db7b-68f7-47e2-8e29-2b765d5c1c57 req-c7e74d1c-2d92-4aa5-ab8b-102e797e9f80 service nova] Creating event network-changed:3f82229d-ed31-4b55-ac47-c7a8393800cd for instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 on hv-cinder-81561 Nov 03 02:10:11.027810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-4b50db7b-68f7-47e2-8e29-2b765d5c1c57 req-c7e74d1c-2d92-4aa5-ab8b-102e797e9f80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029637 Nov 03 02:10:11.029358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 548/1110] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:10:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:11.063483 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ab246a6a-9e97-4310-8d53-f1e64a3777b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.074005 Nov 03 02:10:11.064483 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 563/1111] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:10 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:12.074739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:12.075645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:12.081743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:12.082222 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:12.082995 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:12.083427 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:12.139477 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-549e9016-5016-4657-93e1-6e5c61f89415 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.069094 Nov 03 02:10:12.140119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 549/1112] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:12 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:13.150685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:13.151688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:13.158538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:13.158989 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:13.159762 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:13.160196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:13.218909 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-af572543-7ed2-4c21-ace4-a26513c47546 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.072166 Nov 03 02:10:13.219499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 564/1113] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:13 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:14.230488 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:14.231481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:14.238237 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:14.238683 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:14.239450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:14.239882 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:14.297012 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b0bd1517-b2a3-4797-991b-63a5aa854eee tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.070360 Nov 03 02:10:14.297529 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 550/1114] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:14 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:15.308024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:15.331965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:15.331965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:15.331965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:15.331965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:15.332392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:15.372567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f8014ae5-6ae1-4d1d-8473-c58d6bae0dbd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.068881 Nov 03 02:10:15.373156 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 565/1115] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:15 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:16.384036 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:16.385026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:16.392116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:16.392557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:16.393320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:16.394026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:16.455233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e337627d-650e-4e77-a590-db775ae37eef tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.075006 Nov 03 02:10:16.458733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 551/1116] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:16 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:17.018013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:17.019229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:17.021310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-f69a868d-d469-43eb-97df-755d11f58e5c req-2bc4f724-a94c-46fa-9054-416af9b9622d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:17.022814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:10:17.022814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:10:17.026824 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.027272 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.028051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.028661 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.031217 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f69a868d-d469-43eb-97df-755d11f58e5c req-2bc4f724-a94c-46fa-9054-416af9b9622d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.031694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f69a868d-d469-43eb-97df-755d11f58e5c req-2bc4f724-a94c-46fa-9054-416af9b9622d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.044407 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-f69a868d-d469-43eb-97df-755d11f58e5c req-2bc4f724-a94c-46fa-9054-416af9b9622d service nova] Creating event network-changed:9fede95c-7a4c-431b-802a-bfb045b4ba84 for instance bfcedc8e-ab45-4300-9e60-6e82319256b8 on hv-cinder-81561 Nov 03 02:10:17.049905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-f69a868d-d469-43eb-97df-755d11f58e5c req-2bc4f724-a94c-46fa-9054-416af9b9622d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032521 Nov 03 02:10:17.050646 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 552/1117] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:10:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:10:17.060386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Going to try to terminate instance {{(pid=123012) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:10:17.405822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-5af78e8d-358c-4203-8865-0f8a82d3466e tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 204 len: 0 microversion: 2.1 time: 0.391671 Nov 03 02:10:17.406926 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 566/1118] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:10:17 2021] DELETE /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:10:17.416618 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:17.418051 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:17.425575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.426399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.427800 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.428431 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.467015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:17.468419 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:17.476320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.477232 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.478295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:17.478993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:17.539833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ad4752f7-ee5c-4170-a300-6a87b77d947b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.076659 Nov 03 02:10:17.542657 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 567/1119] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:17 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:17.695068 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:17.702755 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-da81886f-6f02-42a3-a3f6-3b5902010e9a tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1569 microversion: 2.1 time: 0.291224 Nov 03 02:10:17.703542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 553/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:17 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:18.552184 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:18.558677 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:18.564446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:18.565196 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:18.565716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:18.566169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:18.628880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fc15eded-4df3-4b56-b024-8afcee80022a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.081046 Nov 03 02:10:18.629516 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 568/1121] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:18 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:18.719307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:18.720194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:18.730622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:18.731186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:18.731998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:18.732464 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:18.863552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:18.870733 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7b05c826-4cfe-41e6-8437-e51ac87f0d97 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1451 microversion: 2.1 time: 0.155180 Nov 03 02:10:18.871295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 554/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:18 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:19.578623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-367ddcf0-2833-4034-99b8-ff529e54fc8c req-7213cf2c-5021-4985-9395-8341eca3614f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcedc8e-ab45-4300-9e60-6e82319256b8", "name": "network-vif-deleted", "tag": "9fede95c-7a4c-431b-802a-bfb045b4ba84"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:19.580116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:10:19.580116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:10:19.588622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-367ddcf0-2833-4034-99b8-ff529e54fc8c req-7213cf2c-5021-4985-9395-8341eca3614f service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:19.589040 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-367ddcf0-2833-4034-99b8-ff529e54fc8c req-7213cf2c-5021-4985-9395-8341eca3614f service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:19.600183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-367ddcf0-2833-4034-99b8-ff529e54fc8c req-7213cf2c-5021-4985-9395-8341eca3614f service nova] Creating event network-vif-deleted:9fede95c-7a4c-431b-802a-bfb045b4ba84 for instance bfcedc8e-ab45-4300-9e60-6e82319256b8 on hv-cinder-81561 Nov 03 02:10:19.606552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-367ddcf0-2833-4034-99b8-ff529e54fc8c req-7213cf2c-5021-4985-9395-8341eca3614f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Nov 03 02:10:19.610667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 569/1123] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:19.639202 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:19.640209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:19.646542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:19.646994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:19.648277 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:19.648713 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:19.706520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-eee49559-1fdc-460d-93d6-f29f794c8453 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.070811 Nov 03 02:10:19.707141 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 555/1124] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:19 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:19.888627 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:19.889644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:19.896515 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:19.900069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:19.900069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:19.900069 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:19.964540 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:19.972038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c8190e81-e0cb-4ce2-8141-9b733cb19322 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1220 microversion: 2.1 time: 0.087472 Nov 03 02:10:19.972625 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 570/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:19 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:20.717245 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:20.718501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:20.725259 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:20.725723 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:20.726587 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:20.727022 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:20.791458 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-60bdf209-85b4-4e0b-8452-511e6a41be2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 14 microversion: 2.1 time: 0.074252 Nov 03 02:10:20.791458 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 556/1126] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:20 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:10:20.988588 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:20.989172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:20.996203 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:20.996648 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:20.997405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:20.997832 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:21.026505 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:21.026942 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:21.027371 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lazy-loading 'fault' on Instance uuid bfcedc8e-ab45-4300-9e60-6e82319256b8 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:10:21.067123 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f07b2b1d72456fb282fd434d73e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136f0a28eb6d4e108836305888f1fcb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:10:21.074345 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-fbec8253-2afd-4eee-933c-0afe9978597f tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 200 len: 1225 microversion: 2.1 time: 0.089362 Nov 03 02:10:21.074898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 571/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:20 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:21.799132 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:21.800167 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:21.807295 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:21.807744 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:21.808512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:21.808947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:21.881150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-96a1beb2-da2a-41c5-83e3-052610a57972 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 8229 microversion: 2.1 time: 0.085867 Nov 03 02:10:21.881818 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 557/1128] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:21 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 8229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:10:22.091765 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:22.092379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] [instance: bfcedc8e-ab45-4300-9e60-6e82319256b8] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:22.098572 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:22.099019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:22.099781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:22.100210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:22.114240 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] HTTP exception thrown: Instance bfcedc8e-ab45-4300-9e60-6e82319256b8 could not be found. Nov 03 02:10:22.114817 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Returning 404 to user: Instance bfcedc8e-ab45-4300-9e60-6e82319256b8 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:10:22.115611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0c43f16c-a7b8-4530-8fbb-1d1c4f9420aa tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8" status: 404 len: 111 microversion: 2.1 time: 0.027610 Nov 03 02:10:22.116129 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 572/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:10:22 2021] GET /compute/v2.1/servers/bfcedc8e-ab45-4300-9e60-6e82319256b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:10:22.324620 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b7e530ed-60ac-42e3-ab9b-2b64fe895f99 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] Calling method '.version_select at 0x7f30c44304c0>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:22.384067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b7e530ed-60ac-42e3-ab9b-2b64fe895f99 tempest-TestShelveInstance-1101481351 tempest-TestShelveInstance-1101481351-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1404425520" status: 202 len: 0 microversion: 2.1 time: 0.063399 Nov 03 02:10:22.384603 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 558/1130] 10.222.0.30 () {58 vars in 1253 bytes} [Wed Nov 3 02:10:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1404425520 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:10:22.892176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:22.893133 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:22.899319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:22.899759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:22.900514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:22.900937 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:22.968466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-52cc9f6c-a569-4f34-88be-46b20383a243 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 16280 microversion: 2.1 time: 0.079829 Nov 03 02:10:22.972087 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 573/1131] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:22 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 16280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:23.980287 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:23.981963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:23.988239 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:23.988884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:23.989742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:23.990194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:24.061788 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7b295558-2f62-4aff-b478-9f4d23bb6e5d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 18608 microversion: 2.1 time: 0.086060 Nov 03 02:10:24.062716 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 559/1132] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:23 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 18608 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:25.074578 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:25.075603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:25.082538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:25.082984 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:25.083749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:25.084180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:25.154238 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-730731ff-2a07-4509-9d1d-4eed43e5aa2d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 20991 microversion: 2.1 time: 0.084030 Nov 03 02:10:25.154936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 574/1133] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:25 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 20991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:26.165836 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:26.166789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:26.174113 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:26.174583 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:26.175368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:26.175798 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:26.255649 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9d9dd141-70e4-44d8-a2ec-50413c2c5454 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 22975 microversion: 2.1 time: 0.093832 Nov 03 02:10:26.256890 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 560/1134] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:26 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 22975 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:27.267617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:27.268619 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:27.276023 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:27.276468 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:27.277253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:27.277688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:27.347981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-31d0882c-f179-4105-8c7c-66bc18f1cae0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 24469 microversion: 2.1 time: 0.084118 Nov 03 02:10:27.348560 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 575/1135] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:27 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 24469 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:28.359998 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:28.361121 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:28.368050 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:28.368536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:28.369324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:28.369739 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:28.442344 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-37df5f7b-04e8-4377-840e-4df262d08913 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 26105 microversion: 2.1 time: 0.086173 Nov 03 02:10:28.444416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 561/1136] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:28 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 26105 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:29.454641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:29.455688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:29.462504 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:29.462999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:29.464221 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:29.464656 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:29.541857 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-feec4fa7-96bd-4afc-a510-fd49855d36a9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 27289 microversion: 2.1 time: 0.091063 Nov 03 02:10:29.543293 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 576/1137] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:29 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 27289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:30.555210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:30.556200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:30.563062 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:30.563506 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:30.564273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:30.565182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:30.640776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fb6bc5f4-a39e-412c-b65e-dafc1107d7c0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 27932 microversion: 2.1 time: 0.090226 Nov 03 02:10:30.641420 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 562/1138] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:30 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 27932 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:31.652819 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:31.653811 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:31.660538 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:31.660977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:31.661730 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:31.662169 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:31.736540 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-36e05765-9d48-499a-b4df-8b6145694d66 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 28245 microversion: 2.1 time: 0.088269 Nov 03 02:10:31.737148 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 577/1139] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:31 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 28245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:32.748446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:32.749441 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:32.756161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:32.756604 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:32.757363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:32.757790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:32.821893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-41d6d4db-5dd3-4367-892c-55ca8c459b83 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 28245 microversion: 2.1 time: 0.077341 Nov 03 02:10:32.822517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 563/1140] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:32 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 28245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:33.833963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:33.834914 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:33.841781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:33.842248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:33.843016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:33.843448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:33.919146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6edaa87b-2033-425c-b999-5c02bd9b3ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 28535 microversion: 2.1 time: 0.089172 Nov 03 02:10:33.919767 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 578/1141] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:33 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 28535 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:34.937193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:34.938226 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:34.945700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:34.946168 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:34.946946 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:34.947382 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:35.024433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-17e1c66b-a3ee-4b67-a669-51882997b335 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 28703 microversion: 2.1 time: 0.091159 Nov 03 02:10:35.025090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 564/1142] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:34 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 28703 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:36.036476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:36.037481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:36.044540 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:36.044981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:36.045781 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:36.046241 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:36.111472 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b2df2d49-4080-4f13-a6f2-35ac9fd03adc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 28703 microversion: 2.1 time: 0.078876 Nov 03 02:10:36.112103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 579/1143] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:36 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 28703 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:37.123438 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:37.124427 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:37.131232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:37.131673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:37.132433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:37.132862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:37.202235 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b213a798-c852-45f7-9d59-b881dab9de71 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 28703 microversion: 2.1 time: 0.082647 Nov 03 02:10:37.202844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 565/1144] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:37 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 28703 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:38.214977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:38.216003 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:38.222827 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:38.223275 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:38.224058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:38.224496 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:38.296365 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a76d36cb-c184-4f7c-b5f2-ea178f224da4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 30402 microversion: 2.1 time: 0.085873 Nov 03 02:10:38.297004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 580/1145] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:38 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 30402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:39.309035 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:39.310025 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:39.317161 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:39.317602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:39.318505 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:39.320085 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:39.389233 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6f62b531-c247-4ca7-9b22-23b534903957 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 32553 microversion: 2.1 time: 0.084115 Nov 03 02:10:39.390221 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 566/1146] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:39 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 32553 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:40.402804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:40.403822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:40.410611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:40.411052 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:40.411809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:40.412235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:40.485331 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-24b2f328-fe39-4314-889e-0db3c7e1449d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 33783 microversion: 2.1 time: 0.086250 Nov 03 02:10:40.485895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 581/1147] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:40 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 33783 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:41.500310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:41.501524 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:41.509895 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:41.510359 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:41.511116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:41.511602 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:41.593299 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-df173992-074d-40f2-8cbb-84b5a96168ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 35074 microversion: 2.1 time: 0.099154 Nov 03 02:10:41.594006 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 567/1148] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:41 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 35074 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:42.605992 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:42.607021 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:42.613889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:42.614365 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:42.615138 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:42.615573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:42.692165 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8f2d07ed-ed3f-446a-ad1a-63cf99b33338 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 36400 microversion: 2.1 time: 0.090719 Nov 03 02:10:42.692818 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 582/1149] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:42 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 36400 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:43.705258 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:43.706278 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:43.713606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:43.714046 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:43.714827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:43.715253 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:43.784002 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b04ff25f-225d-4000-881a-b2bfe8da7680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 38020 microversion: 2.1 time: 0.082626 Nov 03 02:10:43.784613 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 568/1150] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:43 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 38020 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:44.796313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:44.797318 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:44.804532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:44.804981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:44.805761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:44.806223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:44.879364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8c960b59-4f97-4b71-8e48-d1e1c5b98c93 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 38234 microversion: 2.1 time: 0.087000 Nov 03 02:10:44.880295 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 583/1151] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:44 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 38234 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:45.892094 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:45.893101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:45.900525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:45.900971 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:45.901743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:45.902200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:45.962502 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b0c196cd-1128-41f3-bd74-7cb7325be71c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 38234 microversion: 2.1 time: 0.074282 Nov 03 02:10:45.963432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 569/1152] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:45 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 38234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:46.974880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:46.976541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:46.983359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:46.983809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:46.984584 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:46.985018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:47.044865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f7e94f29-3629-49f6-bf16-f559cf14654a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 38234 microversion: 2.1 time: 0.073843 Nov 03 02:10:47.045532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 584/1153] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:46 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 38234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:10:48.058196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:48.059210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:48.066069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:48.066545 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:48.067317 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:48.067757 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:48.128321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f7647949-011c-4ed1-99b2-6833fd4efb75 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 38234 microversion: 2.1 time: 0.074981 Nov 03 02:10:48.128990 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 570/1154] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:48 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 38234 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:49.140837 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:49.141900 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:49.148796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:49.149248 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:49.150017 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:49.150478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:49.224122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3b962a2a-cbbb-4f3d-b742-87b0e61e5a27 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 200 len: 38363 microversion: 2.1 time: 0.086865 Nov 03 02:10:49.224679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 585/1155] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:49 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 38363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:10:49.235340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:10:49.236027 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:49.243786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:49.275773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:49.275773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:49.275773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:49.275773 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ed341d55-0664-4e00-8770-a2d6e49e3e6b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/ips" status: 200 len: 144 microversion: 2.1 time: 0.041423 Nov 03 02:10:49.276272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 571/1156] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Nov 3 02:10:49 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:51.648305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d8e9be-552d-411a-819f-47a93e223a6f"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:51.649438 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:10:51.656160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:51.656603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:51.657361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:51.657787 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:10:52.466363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-231fb517-8f66-4a31-93b1-73368db7d644 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821867 Nov 03 02:10:52.466986 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 586/1157] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:10:51 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:10:59.929200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-87e74f42-b684-4369-9391-b808193d1925 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:10:59.935396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-87e74f42-b684-4369-9391-b808193d1925 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:10:59.935834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-87e74f42-b684-4369-9391-b808193d1925 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:00.001867 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-87e74f42-b684-4369-9391-b808193d1925 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Going to try to stop instance {{(pid=123011) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 03 02:11:00.207266 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-87e74f42-b684-4369-9391-b808193d1925 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 202 len: 0 microversion: 2.1 time: 0.282420 Nov 03 02:11:00.207907 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 572/1158] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:10:59 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:11:00.218854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:00.220112 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:00.227592 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:00.228035 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:00.228811 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:00.229321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:00.376546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:00.384938 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4e3d1529-7a58-428c-be55-0f94113641c4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.172081 Nov 03 02:11:00.385511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 587/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:00 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:01.406086 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:01.406794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:01.412753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:01.413187 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:01.413939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:01.414389 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:01.542697 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:01.550361 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d495716d-9545-438e-8ae5-e54c0cd2fc56 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.148735 Nov 03 02:11:01.550924 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 573/1160] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:01 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:02.568583 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:02.569769 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:02.577318 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:02.577764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:02.578576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:02.579009 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:02.705160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:02.713256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-64363b83-1670-4139-a841-3ab88e5923b0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.149241 Nov 03 02:11:02.713818 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 588/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:02 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:03.730631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:03.731229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:03.737440 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:03.738195 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:03.738650 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:03.739073 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:03.867904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:03.875511 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9cc4c040-1dc5-46f4-a642-60a0e2783fd7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.148588 Nov 03 02:11:03.876072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 574/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:03 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:04.892640 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:04.893235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:04.899462 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:04.899909 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:04.900679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:04.901112 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:05.029744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:05.037402 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b7dd0747-829d-4c28-984b-4c1f109007b1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.148457 Nov 03 02:11:05.037994 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 589/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:04 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:06.054348 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:06.054942 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:06.061096 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:06.061538 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:06.062327 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:06.062753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:06.519226 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:06.529586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-13974d6b-4725-4487-8938-1871ea778f44 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.479114 Nov 03 02:11:06.531165 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 575/1164] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:06 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:07.547872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:07.548471 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:07.555476 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:07.555910 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:07.556669 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:07.557093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:07.683958 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:07.691463 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d074be03-4aa3-42dc-b2cc-2a447153bfbc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.147901 Nov 03 02:11:07.692024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 590/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:07 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:08.707910 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:08.708517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:08.715310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:08.715756 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:08.716520 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:08.716953 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:08.853913 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:08.861753 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cc1d6ed1-0c9b-4c7f-9ced-261ec3e4802e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.157512 Nov 03 02:11:08.862357 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 576/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:08 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:09.878565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:09.879172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:09.885874 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:09.886364 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:09.887135 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:09.887568 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:10.013442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:10.021039 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-526bf2ab-fde7-4927-af8c-7e6144176cd2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.146130 Nov 03 02:11:10.021605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 591/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:09 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:10.071350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:10.071904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:10.077941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:10.078423 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:10.079190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:10.079646 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:10.259186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:11:10.615242 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-de12cebe-ac91-4f6e-9ebc-8701e2063dbe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 204 len: 0 microversion: 2.1 time: 0.547810 Nov 03 02:11:10.616439 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 577/1168] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:11:10 2021] DELETE /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:11:10.624193 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:10.624855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:10.630741 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:10.631210 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:10.632541 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:10.632988 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:10.764576 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:10.772467 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-64f82971-1786-4210-b0dd-0d88c60a17e4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1577 microversion: 2.1 time: 0.151320 Nov 03 02:11:10.773039 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 592/1169] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:10 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:11.039365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:11.040050 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:11.045812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:11.046289 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:11.047052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:11.047475 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:11.178808 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:11.186402 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1919667f-c713-43d6-913b-f25e1df8065a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.151640 Nov 03 02:11:11.186950 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 578/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:11 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:11:11.789484 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:11.790124 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:11.796223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:11.796669 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:11.797442 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:11.797872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:11.931963 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:11.939287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-18e77995-2c2e-4316-a687-157b473e4868 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1577 microversion: 2.1 time: 0.153434 Nov 03 02:11:11.939898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 593/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:11 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:12.203672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:12.204215 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:12.210365 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:12.211031 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:12.211573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:12.212109 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:12.427921 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:12.435648 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a85f55c7-bdd7-4c39-a3d7-18201ad920ed tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.235785 Nov 03 02:11:12.436212 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 579/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:12 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:12.956231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:12.956838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:12.963202 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:12.963647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:12.964452 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:12.964878 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:13.031380 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:13.039349 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ec23e80c-1f27-4bc7-9245-848c32f03cf8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1509 microversion: 2.1 time: 0.086797 Nov 03 02:11:13.039916 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 594/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:12 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1509 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:13.201377 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-43c76472-78db-4fd9-904a-852e7c5a0c3f req-764904bb-b24e-475a-8ae8-38bf273cdd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac3d5d-bfe6-4665-a05e-4e43603bdeea", "name": "network-vif-deleted", "tag": "965fb444-aa57-4bbf-bf8d-51156d65ecb3"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:13.202939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:11:13.202939 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:11:13.210701 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-43c76472-78db-4fd9-904a-852e7c5a0c3f req-764904bb-b24e-475a-8ae8-38bf273cdd32 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:13.211321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-43c76472-78db-4fd9-904a-852e7c5a0c3f req-764904bb-b24e-475a-8ae8-38bf273cdd32 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:13.222735 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-43c76472-78db-4fd9-904a-852e7c5a0c3f req-764904bb-b24e-475a-8ae8-38bf273cdd32 service nova] Creating event network-vif-deleted:965fb444-aa57-4bbf-bf8d-51156d65ecb3 for instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea on hv-cinder-81561 Nov 03 02:11:13.228607 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-43c76472-78db-4fd9-904a-852e7c5a0c3f req-764904bb-b24e-475a-8ae8-38bf273cdd32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030773 Nov 03 02:11:13.229280 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 580/1174] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:11:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:11:13.451702 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:13.452313 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:13.458601 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:13.459108 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:13.460567 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:13.460998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:13.599000 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:13.605898 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ff71a680-5381-492f-85ed-88ae4451d4d7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.157748 Nov 03 02:11:13.615516 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 595/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:13 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:14.057863 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:14.058844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:14.066061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:14.066061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:14.066955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:14.067394 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:14.099072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:14.099072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:14.099450 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lazy-loading 'fault' on Instance uuid e2ac3d5d-bfe6-4665-a05e-4e43603bdeea {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:11:14.140163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:14.147493 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-cb5081b7-f1ae-4db4-a209-246d523693ee tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 200 len: 1231 microversion: 2.1 time: 0.094503 Nov 03 02:11:14.148308 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 581/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:14 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:14.622551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:14.623218 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:14.629396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:14.629841 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:14.630642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:14.631114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:14.762489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:14.770267 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-00d8c2b4-340b-47ea-9fd3-14c0e5fb424f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1719 microversion: 2.1 time: 0.151345 Nov 03 02:11:14.770833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 596/1177] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:14 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:15.171209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:15.171793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:15.178250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.178700 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.179466 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.179900 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.192905 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] HTTP exception thrown: Instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea could not be found. Nov 03 02:11:15.193969 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Returning 404 to user: Instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:11:15.194812 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ed140cc0-33fa-4086-9978-1212627a9253 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 404 len: 111 microversion: 2.1 time: 0.027341 Nov 03 02:11:15.195323 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 582/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:15 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:11:15.288177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-433631616", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1143971476", "security_groups": [{"name": "tempest-secgroup-smoke-2008507579"}], "block_device_mapping_v2": [{"uuid": "62721d1b-1e4d-4358-80bd-f5bfb8649978", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f712cad4-e8ca-42ec-98fb-45f5bacc0fc1"}]}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:15.394944 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.network.neutron [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] validate_networks() for [('f712cad4-e8ca-42ec-98fb-45f5bacc0fc1', None, None, None, None, None)] {{(pid=123012) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:11:15.771175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Flavor limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:11:15.772229 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Image limits 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:11:15.772597 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Flavor pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:11:15.773027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Image pref 0:0:0 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:11:15.773429 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.virt.hardware [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:11:15.782618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.783058 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.783858 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.784287 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.787531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:15.788142 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:15.793806 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.794290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.795061 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.795495 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.800091 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for project a08b0f1fc6b940148531ae61a6847288. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:11:15.804180 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for user a9d618d410254d658124e5ee5ae46df2 and project a08b0f1fc6b940148531ae61a6847288. Resources: {'instances', 'ram', 'cores'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:11:15.858481 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Going to run 1 instances... {{(pid=123012) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:11:15.860589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62721d1b-1e4d-4358-80bd-f5bfb8649978',volume_size=None,volume_type=None)] {{(pid=123012) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:11:15.927916 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:15.936332 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-ee2088a9-69a9-4992-b18d-28373b728933 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1696 microversion: 2.1 time: 0.152437 Nov 03 02:11:15.936892 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 583/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:15 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:15.952106 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-980d17f0-d906-4f77-9744-f7f37f3405c1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:15.957889 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-980d17f0-d906-4f77-9744-f7f37f3405c1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:15.958515 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-980d17f0-d906-4f77-9744-f7f37f3405c1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:15.980455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-980d17f0-d906-4f77-9744-f7f37f3405c1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Going to try to start instance {{(pid=123011) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 03 02:11:16.337764 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-980d17f0-d906-4f77-9744-f7f37f3405c1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 202 len: 0 microversion: 2.1 time: 0.388979 Nov 03 02:11:16.338722 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 584/1180] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:11:15 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:11:16.346399 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:16.347166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:16.353183 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:16.353629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:16.354426 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:16.354846 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:16.493383 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-935f75bb-71d6-4019-9620-2b579c1f89d8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.209396 Nov 03 02:11:16.499397 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 597/1181] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:11:15 2021] POST /compute/v2.1/servers => generated 406 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:11:16.504892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3bb64492-2c42-4fe7-9d24-f2f3831a9735 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:16.505510 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3bb64492-2c42-4fe7-9d24-f2f3831a9735 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:16.507172 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:16.515367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6631e701-480e-4e4e-bbe6-d4486751d2af tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1705 microversion: 2.1 time: 0.172770 Nov 03 02:11:16.515940 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 585/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:16 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1705 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:16.582250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3bb64492-2c42-4fe7-9d24-f2f3831a9735 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:16.594327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3bb64492-2c42-4fe7-9d24-f2f3831a9735 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1094 microversion: 2.1 time: 0.093174 Nov 03 02:11:16.595081 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 598/1183] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:16 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:17.532007 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:17.532616 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:17.539045 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:17.539494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:17.540273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:17.541158 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:17.611853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:17.612456 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:17.619930 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:17.620379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:17.621157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:17.621591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:17.688196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:17.696522 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f5857cdb-1f41-499d-9f68-f984aa8f0b3b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1705 microversion: 2.1 time: 0.168201 Nov 03 02:11:17.697474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 586/1184] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:17 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1705 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:17.707347 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:17.715045 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4fdb3be9-bd9c-4801-8058-eea0ffa07bca tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1144 microversion: 2.1 time: 0.106982 Nov 03 02:11:17.715604 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 599/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:17 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:11:18.714052 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:18.714796 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:18.720992 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:18.721510 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:18.722385 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:18.722822 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:18.731565 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:18.732244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:18.738872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:18.743605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:18.743605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:18.743605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:18.831579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:18.839310 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-20642392-9221-4edb-88bb-ba3baa0f9e9f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1200 microversion: 2.1 time: 0.111393 Nov 03 02:11:18.840205 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 600/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:18 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:11:18.911955 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:18.920632 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4e9f5586-499e-479e-be0c-3bf0835bcd3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1709 microversion: 2.1 time: 0.210272 Nov 03 02:11:18.921455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 587/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:18 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1709 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:19.856725 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:19.857443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:19.863703 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:19.864151 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:19.864925 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:19.865359 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:20.093228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:20.101532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2d09d2e2-2e0d-40b4-a771-735fd3913025 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1278 microversion: 2.1 time: 0.248502 Nov 03 02:11:20.102226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 601/1188] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:19 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:20.580180 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-3c9a109b-22ff-4e8c-aa5d-315386e5b218 req-eb43d50c-f8db-4a41-8e9b-b235c43fce37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7a5a05-f330-4efd-8bb2-d11ec928e3a2", "tag": "e4f46ead-c149-4eee-ac3c-12255a6be4f7"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:20.582029 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:11:20.582029 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:11:20.591837 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-3c9a109b-22ff-4e8c-aa5d-315386e5b218 req-eb43d50c-f8db-4a41-8e9b-b235c43fce37 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:20.592282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-3c9a109b-22ff-4e8c-aa5d-315386e5b218 req-eb43d50c-f8db-4a41-8e9b-b235c43fce37 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:20.605356 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-3c9a109b-22ff-4e8c-aa5d-315386e5b218 req-eb43d50c-f8db-4a41-8e9b-b235c43fce37 service nova] Creating event network-changed:e4f46ead-c149-4eee-ac3c-12255a6be4f7 for instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 on hv-cinder-81561 Nov 03 02:11:20.611300 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-3c9a109b-22ff-4e8c-aa5d-315386e5b218 req-eb43d50c-f8db-4a41-8e9b-b235c43fce37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034277 Nov 03 02:11:20.611904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 588/1189] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:11:21.122246 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:21.122853 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:21.128985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:21.134333 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:21.134333 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:21.134333 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:21.587356 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:21.594423 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-12be3799-fd3e-4b34-9bb0-45b8743b5ae1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.475900 Nov 03 02:11:21.594993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 602/1190] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:21 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:22.613667 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:22.614395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:22.621395 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:22.621844 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:22.622652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:22.623090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:22.753590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:22.761253 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-052ab13f-beea-43dd-b2d6-4eff4d83ef6f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.151580 Nov 03 02:11:22.761814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 589/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:22 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:23.778429 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:23.779026 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:23.785764 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:23.786277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:23.787664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:23.788101 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:23.914245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:23.921358 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a885f736-6af9-456b-851f-df3101c933ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.146867 Nov 03 02:11:23.921923 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 603/1192] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:23 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:24.942503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:24.943984 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:24.950570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:24.951016 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:24.951786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:24.952216 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:25.087593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:25.094749 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-065c7fd0-f3ed-4ee9-a6a6-c709b0a3b6ce tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.159220 Nov 03 02:11:25.095298 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 590/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:24 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:26.110251 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:26.110880 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:26.117182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:26.117619 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:26.118408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:26.118834 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:26.247491 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:26.257675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-8ffe6f6f-04ea-418e-848c-a8c9c0ba7f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.151097 Nov 03 02:11:26.258265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 604/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:26 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:27.274731 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:27.275325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:27.281514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:27.281966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:27.282784 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:27.283219 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:27.413325 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:27.420480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a8190273-5258-46cf-9dff-d6f2472eea0e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.149978 Nov 03 02:11:27.421044 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 591/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:27 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:28.436131 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:28.436734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:28.442897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:28.443365 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:28.444122 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:28.444545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:28.573739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:28.580887 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-be0f4a6f-9314-4b7e-986c-e8364bf68b10 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.148367 Nov 03 02:11:28.581454 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 605/1196] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:28 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:29.596489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:29.597123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:29.603375 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:29.603818 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:29.604584 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:29.605015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:29.734670 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:29.742673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-66d015c9-aa8b-45af-afc4-b135c6b1d3f7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.149812 Nov 03 02:11:29.746175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 592/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:29 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:30.759859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:30.760465 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:30.766575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:30.767022 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:30.767790 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:30.768223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:30.901641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:30.907700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-61d08ed5-b080-4cf9-a621-8a662b87f64c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.152104 Nov 03 02:11:30.908273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 606/1198] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:30 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:31.924256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:31.924860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:31.931373 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:31.931814 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:31.932575 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:31.932999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:32.061535 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:32.068794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1c9c1c22-de54-46c0-b78c-c10c46eead78 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.148149 Nov 03 02:11:32.069350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 593/1199] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:31 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:32.363142 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-dc831031-fd3b-4664-983a-66849aa4f42b req-efcf1fa8-f920-403c-be2a-ae5529a3c36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7a5a05-f330-4efd-8bb2-d11ec928e3a2", "name": "network-vif-plugged", "status": "completed", "tag": "e4f46ead-c149-4eee-ac3c-12255a6be4f7"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:32.364804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:11:32.364804 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:11:32.371959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-dc831031-fd3b-4664-983a-66849aa4f42b req-efcf1fa8-f920-403c-be2a-ae5529a3c36d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:32.372393 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-dc831031-fd3b-4664-983a-66849aa4f42b req-efcf1fa8-f920-403c-be2a-ae5529a3c36d service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:32.383311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-dc831031-fd3b-4664-983a-66849aa4f42b req-efcf1fa8-f920-403c-be2a-ae5529a3c36d service nova] Creating event network-vif-plugged:e4f46ead-c149-4eee-ac3c-12255a6be4f7 for instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 on hv-cinder-81561 Nov 03 02:11:32.388376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-dc831031-fd3b-4664-983a-66849aa4f42b req-efcf1fa8-f920-403c-be2a-ae5529a3c36d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029016 Nov 03 02:11:32.391586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 607/1200] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:11:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:11:33.085970 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:33.086608 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:33.093703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:33.094557 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:33.095990 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:33.096609 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:33.225752 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:33.232888 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-e28d4021-01a0-4870-930d-9d17fc664cc7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1266 microversion: 2.1 time: 0.151398 Nov 03 02:11:33.233444 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 594/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:33 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:34.251489 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:34.252177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:34.258928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:34.259253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:34.260016 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:34.260443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:34.389068 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:34.396235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-13b6119f-944c-4360-85a1-036ed93c7b97 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1453 microversion: 2.1 time: 0.149195 Nov 03 02:11:34.396796 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 608/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:34 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:34.412093 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:34.412698 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:34.418768 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:34.419210 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:34.419966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:34.420394 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:34.554794 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:34.562057 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3fad42e2-ea0d-49c0-9af0-f28fa7a806b0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1453 microversion: 2.1 time: 0.153991 Nov 03 02:11:34.562653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 595/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:34 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:36.502329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-e4d9f8c0-6214-4f56-a746-f6887cc62265 req-fb36cbf2-3d0c-4402-bfed-31dcfd863f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7a5a05-f330-4efd-8bb2-d11ec928e3a2", "tag": "e4f46ead-c149-4eee-ac3c-12255a6be4f7"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:36.504622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:11:36.504622 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:11:36.511486 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e4d9f8c0-6214-4f56-a746-f6887cc62265 req-fb36cbf2-3d0c-4402-bfed-31dcfd863f1a service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:36.511998 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-e4d9f8c0-6214-4f56-a746-f6887cc62265 req-fb36cbf2-3d0c-4402-bfed-31dcfd863f1a service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:36.523253 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-e4d9f8c0-6214-4f56-a746-f6887cc62265 req-fb36cbf2-3d0c-4402-bfed-31dcfd863f1a service nova] Creating event network-changed:e4f46ead-c149-4eee-ac3c-12255a6be4f7 for instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 on hv-cinder-81561 Nov 03 02:11:36.528165 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-e4d9f8c0-6214-4f56-a746-f6887cc62265 req-fb36cbf2-3d0c-4402-bfed-31dcfd863f1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036002 Nov 03 02:11:36.528775 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 609/1204] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:11:51.596543 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:51.597063 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:51.602975 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:51.603432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:51.604197 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:51.604636 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:51.679811 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.objects.instance [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lazy-loading 'services' on Instance uuid c9f31bdf-2f02-4be5-b437-7e26dcceb512 {{(pid=123011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:11:51.905008 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0f25871b-205d-48b8-b1a3-cd789b4f4ac1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-volume_attachments/77d8e9be-552d-411a-819f-47a93e223a6f" status: 202 len: 0 microversion: 2.1 time: 0.312154 Nov 03 02:11:51.905586 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 596/1205] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:11:51 2021] DELETE /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-volume_attachments/77d8e9be-552d-411a-819f-47a93e223a6f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:11:53.008351 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d79a3037-c42e-4613-b23d-358004887bc4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:11:53.014813 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d79a3037-c42e-4613-b23d-358004887bc4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:53.015262 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d79a3037-c42e-4613-b23d-358004887bc4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:53.083556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d79a3037-c42e-4613-b23d-358004887bc4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Going to try to stop instance {{(pid=123012) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 03 02:11:53.416706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d79a3037-c42e-4613-b23d-358004887bc4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 202 len: 0 microversion: 2.1 time: 0.412883 Nov 03 02:11:53.417412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 610/1206] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:11:53 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:11:53.426709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:53.427408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:53.433856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:53.434378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:53.435155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:53.435595 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:53.565699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:53.573786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-299af0d3-7044-4c84-a771-9b14aff5bb12 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.152111 Nov 03 02:11:53.574396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 597/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:53 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:54.592320 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:54.593011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:54.598965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:54.599401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:54.600160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:54.600580 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:54.725838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:54.732906 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0c9e0f44-f07a-4fa3-8248-be8bda136ac5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.145021 Nov 03 02:11:54.733448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 611/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:54 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:55.749498 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:55.750110 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:55.756316 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:55.756763 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:55.757532 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:55.757964 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:55.888301 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:55.895432 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2f999169-18e0-4c24-846f-72ebd6930637 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.149554 Nov 03 02:11:55.895997 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 598/1209] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:55 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:56.911945 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:56.912552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:56.918893 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:56.919339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:56.920103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:56.920545 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:57.046146 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:57.053534 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1d3671f0-8078-4f57-a221-d133941c22c8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.145274 Nov 03 02:11:57.054089 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 612/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:56 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:11:58.070456 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:58.071064 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:58.077874 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:58.078358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:58.079122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:58.079548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:58.209067 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:58.216866 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1d7e7cb7-6178-4c5c-981a-08d6a2d9a27a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.150156 Nov 03 02:11:58.217433 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 599/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:58 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:11:59.233027 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:11:59.233629 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:11:59.239800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:59.240245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:59.241008 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:11:59.241448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:11:59.372810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:11:59.379712 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6ea9cddb-0464-4996-a8d2-23e17068f8e8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.150386 Nov 03 02:11:59.380264 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 613/1212] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:11:59 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:00.396588 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:00.397228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:00.403563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:00.404010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:00.404774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:00.405209 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:00.530346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:00.537493 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a9f68c85-05e5-4075-8716-06cb6fb2085c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.144589 Nov 03 02:12:00.538075 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 600/1213] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:00 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:01.554654 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:01.555182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:01.562066 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:01.562615 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:01.563339 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:01.563769 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:01.692624 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:01.699772 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-962fc01a-c3fa-4829-a06d-f2764b528ea2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.149088 Nov 03 02:12:01.700321 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 614/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:01 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:02.717002 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:02.717591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:02.723997 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:02.724448 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:02.725227 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:02.725663 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:02.852658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:02.859758 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d1efc35f-f3c2-498b-a0ea-06f99890408b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.146449 Nov 03 02:12:02.860316 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 601/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:02 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:03.876425 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:03.877024 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:03.883195 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:03.883639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:03.884400 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:03.884827 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:04.016677 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:04.024042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a9488002-477f-421b-881d-cf30787eca1b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1673 microversion: 2.1 time: 0.151291 Nov 03 02:12:04.024607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 615/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:03 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:05.041519 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:05.042108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:05.048250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:05.048694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:05.049483 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:05.049912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:05.180662 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:05.188387 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6d5179b4-e686-47a7-bbee-15746b709ce1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1650 microversion: 2.1 time: 0.151222 Nov 03 02:12:05.188938 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 602/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:05 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1650 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:05.204726 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1745cae9-3409-40b6-bb37-466c83411e39 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:12:05.210920 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1745cae9-3409-40b6-bb37-466c83411e39 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:05.211369 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1745cae9-3409-40b6-bb37-466c83411e39 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:05.234357 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1745cae9-3409-40b6-bb37-466c83411e39 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Going to try to start instance {{(pid=123012) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 03 02:12:05.438301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1745cae9-3409-40b6-bb37-466c83411e39 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action" status: 202 len: 0 microversion: 2.1 time: 0.237037 Nov 03 02:12:05.438894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 616/1218] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:12:05 2021] POST /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:12:05.446729 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:05.449380 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:05.453088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:05.453540 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:05.454358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:05.454799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:05.589155 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:05.597033 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-48fa5497-3b7c-492b-b0a0-6476bf036bc0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1659 microversion: 2.1 time: 0.153854 Nov 03 02:12:05.606227 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 603/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:05 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1659 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:06.616216 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:06.616907 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:06.623379 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:06.623823 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:06.624590 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:06.625018 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:06.758849 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:06.766467 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e7483bad-7a85-4fe0-8e93-a6c70fb5865b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1659 microversion: 2.1 time: 0.154733 Nov 03 02:12:06.768219 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 617/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:06 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1659 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:07.783490 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:07.784100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:07.791079 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:07.791527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:07.792297 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:07.792730 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:07.918362 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:07.925550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1315e903-308b-48dd-8575-21b1d6312656 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1663 microversion: 2.1 time: 0.145733 Nov 03 02:12:07.926585 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 604/1221] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:07 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:40.218865 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:40.219779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:40.225659 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:40.226100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:40.226895 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:40.227326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:40.254407 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d7a5d2e3-fc9f-417d-9252-1d92547298f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039219 Nov 03 02:12:40.254934 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 618/1222] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:12:40 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512/os-volume_attachments => generated 25 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:12:40.312484 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:40.313023 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:40.321498 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:40.321941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:40.323354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:40.327346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:40.348232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:12:40.600542 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6d551c9a-0bac-4282-8851-3e882afc5795 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 204 len: 0 microversion: 2.1 time: 0.291663 Nov 03 02:12:40.601140 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 605/1223] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:12:40 2021] DELETE /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:12:40.609042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:40.616655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:40.616655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:40.616655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:40.616655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:40.617097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:41.144855 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:41.152010 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9dde4c9c-a46c-4167-a2d8-fb54ef1ce419 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1669 microversion: 2.1 time: 0.546705 Nov 03 02:12:41.152554 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 619/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:40 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1669 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:42.169383 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:42.169991 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:42.176497 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:42.176948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:42.177708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:42.178159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:42.355708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:42.362977 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-18ea2791-4750-4aa7-b8b1-3a4ea4fbc132 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1669 microversion: 2.1 time: 0.197825 Nov 03 02:12:42.363536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 606/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:42 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1669 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:43.111951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:12:43.112194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: Wed Nov 3 02:12:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:12:43.380607 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:43.381274 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:43.388487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:43.388953 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:43.389751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:43.390235 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:43.460431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:43.468124 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-1d6d55ad-97c3-44e9-ae82-8013c4c9f345 req-5b978b90-0539-4e96-8887-c6a6dfff1422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f31bdf-2f02-4be5-b437-7e26dcceb512", "name": "network-vif-deleted", "tag": "3f82229d-ed31-4b55-ac47-c7a8393800cd"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:12:43.469446 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-91606f04-6ac2-45fb-b6e3-dff1da591d8e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 200 len: 1604 microversion: 2.1 time: 0.092570 Nov 03 02:12:43.470033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 620/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:43 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 1604 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:43.470948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:12:43.470948 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:12:43.478984 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-1d6d55ad-97c3-44e9-ae82-8013c4c9f345 req-5b978b90-0539-4e96-8887-c6a6dfff1422 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:43.479787 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-1d6d55ad-97c3-44e9-ae82-8013c4c9f345 req-5b978b90-0539-4e96-8887-c6a6dfff1422 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:43.500025 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-1d6d55ad-97c3-44e9-ae82-8013c4c9f345 req-5b978b90-0539-4e96-8887-c6a6dfff1422 service nova] Creating event network-vif-deleted:3f82229d-ed31-4b55-ac47-c7a8393800cd for instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 on hv-cinder-81561 Nov 03 02:12:43.505689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-1d6d55ad-97c3-44e9-ae82-8013c4c9f345 req-5b978b90-0539-4e96-8887-c6a6dfff1422 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106570 Nov 03 02:12:43.506504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 607/1227] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:12:44.486747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:44.487294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:44.493426 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:44.493871 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:44.494740 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:44.495177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:44.507928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] HTTP exception thrown: Instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 could not be found. Nov 03 02:12:44.508501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Returning 404 to user: Instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:12:44.509299 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-35d9cd9d-d29e-4d31-98a6-e782b04c9e7d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 404 len: 111 microversion: 2.1 time: 0.026347 Nov 03 02:12:44.509827 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 621/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:44 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:12:44.518340 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a12e8cfe-21f2-41a4-bbf3-b478c3e21391 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '.version_select at 0x7f30c44b2f70>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:44.624514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a12e8cfe-21f2-41a4-bbf3-b478c3e21391 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883806535" status: 202 len: 0 microversion: 2.1 time: 0.110050 Nov 03 02:12:44.625099 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 608/1229] 10.222.0.30 () {58 vars in 1220 bytes} [Wed Nov 3 02:12:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883806535 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 02:12:45.378100 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-016ded0a-390a-4559-9898-5b51c4d94533 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: .version_select at 0x7f30b7ac23a0>, body: {"keypair": {"name": "tempest-keypair-127150931"}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:12:45.395499 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-016ded0a-390a-4559-9898-5b51c4d94533 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:12:45.399277 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-016ded0a-390a-4559-9898-5b51c4d94533 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for user 2dd4afe870ee4c5e88b2fc94035eb855 and project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:12:45.733509 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-016ded0a-390a-4559-9898-5b51c4d94533 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:12:45.737043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.quota [None req-016ded0a-390a-4559-9898-5b51c4d94533 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for user 2dd4afe870ee4c5e88b2fc94035eb855 and project acd183c43fe64f528cb1a54e0e951443. Resources: {'key_pairs'} {{(pid=123012) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:12:45.749843 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-016ded0a-390a-4559-9898-5b51c4d94533 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.375487 Nov 03 02:12:45.750537 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 622/1230] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Nov 3 02:12:45 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:47.800832 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-247394373", "imageRef": "1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cffa4a5f-809a-4e6a-b540-236a07565506"}], "security_groups": [{"name": "tempest-securitygroup--563625335"}], "key_name": "tempest-keypair-127150931", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:12:47.901022 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] validate_networks() for [('cffa4a5f-809a-4e6a-b540-236a07565506', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:12:48.267898 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:12:48.268312 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:12:48.268774 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:12:48.269171 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:12:48.269571 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:12:48.277911 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:48.278390 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:48.279190 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:48.279615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:48.295324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for project acd183c43fe64f528cb1a54e0e951443. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:12:48.299388 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Getting quotas for user 2dd4afe870ee4c5e88b2fc94035eb855 and project acd183c43fe64f528cb1a54e0e951443. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:12:48.310646 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:12:48.313014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1682ec66-71a9-4b18-b0e9-3b7e5bcf32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:12:48.435156 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d905d177-38b4-4a4b-a834-17a68ac11552 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638404 Nov 03 02:12:48.435742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 609/1231] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:12:47 2021] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:12:48.450763 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9fdee1f2-8527-4130-af2d-e1dbd86b38ac tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:48.451905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9fdee1f2-8527-4130-af2d-e1dbd86b38ac tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:48.508993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9fdee1f2-8527-4130-af2d-e1dbd86b38ac tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:48.515508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9fdee1f2-8527-4130-af2d-e1dbd86b38ac tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1236 microversion: 2.1 time: 0.070488 Nov 03 02:12:48.516070 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 623/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:48 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:49.533776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:49.534412 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:49.541232 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:49.541694 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:49.542536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:49.542970 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:49.606258 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:49.613676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7c2f1c13-653f-420a-ba77-93570566f3e6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1232 microversion: 2.1 time: 0.085171 Nov 03 02:12:49.614255 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 610/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:49 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:50.630161 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:50.630758 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:50.636838 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:50.637355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:50.638174 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:50.638603 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:50.715889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:50.722965 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-026fafc6-23bd-42b0-978c-a75305a4d7e7 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1294 microversion: 2.1 time: 0.096481 Nov 03 02:12:50.723517 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 624/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:50 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:51.740256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:51.741582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:51.749175 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:51.749963 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:51.750868 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:51.751362 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:51.903378 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:51.910643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0ea3f356-dc10-448e-a9c8-1d4287b58f47 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1361 microversion: 2.1 time: 0.174074 Nov 03 02:12:51.911119 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 611/1235] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:51 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:51.980551 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-24b3c2f7-f161-4102-950e-237c6c7dc951 req-1093f7c2-98cc-4645-a0e9-72fb6613e758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a425aa4c-e486-46d1-a3b2-6c4bf5c5359f", "tag": "4b5862d0-8505-44dd-bc82-5652650c09b5"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:12:51.982679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:12:51.982679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:12:51.991157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-24b3c2f7-f161-4102-950e-237c6c7dc951 req-1093f7c2-98cc-4645-a0e9-72fb6613e758 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:51.991157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-24b3c2f7-f161-4102-950e-237c6c7dc951 req-1093f7c2-98cc-4645-a0e9-72fb6613e758 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:52.001033 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-24b3c2f7-f161-4102-950e-237c6c7dc951 req-1093f7c2-98cc-4645-a0e9-72fb6613e758 service nova] Creating event network-changed:4b5862d0-8505-44dd-bc82-5652650c09b5 for instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f on hv-cinder-81561 Nov 03 02:12:52.006757 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-24b3c2f7-f161-4102-950e-237c6c7dc951 req-1093f7c2-98cc-4645-a0e9-72fb6613e758 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030221 Nov 03 02:12:52.007556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 625/1236] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:12:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:12:52.927048 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:52.927658 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:52.934474 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:52.934918 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:52.935704 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:52.936131 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:53.066580 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:53.073869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a980e6e3-4f73-4fa3-a228-652bee393680 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1361 microversion: 2.1 time: 0.150687 Nov 03 02:12:53.077129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 612/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:52 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:54.091301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:54.092020 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:54.098032 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:54.098504 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:54.099265 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:54.099691 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:54.230332 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:54.237449 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-bc4391a6-2d0b-46fe-8ea7-35c690adde21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1361 microversion: 2.1 time: 0.150571 Nov 03 02:12:54.238012 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 626/1238] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:54 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:55.254802 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:55.255406 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:55.262047 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:55.262517 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:55.263282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:55.263715 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:55.403125 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:55.410416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9b3c8d1a-4a56-4ec3-b501-d2dcfaab649d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1361 microversion: 2.1 time: 0.159365 Nov 03 02:12:55.410988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 613/1239] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:55 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:56.426980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:56.427586 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:56.434013 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:56.437055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:56.437055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:56.437055 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:56.563381 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:56.571046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-72e65fdb-fde7-46f1-947c-e3e2e87257c9 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1361 microversion: 2.1 time: 0.147937 Nov 03 02:12:56.573773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 627/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:56 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:56.840458 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-f1df2c0a-4f7a-4e67-9c15-f5268922f44b req-9d10096d-f37d-413d-b33f-c5ac4c4d5e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a425aa4c-e486-46d1-a3b2-6c4bf5c5359f", "name": "network-vif-plugged", "status": "completed", "tag": "4b5862d0-8505-44dd-bc82-5652650c09b5"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:12:56.842034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:12:56.842034 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:12:56.848696 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f1df2c0a-4f7a-4e67-9c15-f5268922f44b req-9d10096d-f37d-413d-b33f-c5ac4c4d5e00 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:56.853718 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-f1df2c0a-4f7a-4e67-9c15-f5268922f44b req-9d10096d-f37d-413d-b33f-c5ac4c4d5e00 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:56.861495 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-f1df2c0a-4f7a-4e67-9c15-f5268922f44b req-9d10096d-f37d-413d-b33f-c5ac4c4d5e00 service nova] Creating event network-vif-plugged:4b5862d0-8505-44dd-bc82-5652650c09b5 for instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f on hv-cinder-81561 Nov 03 02:12:56.866480 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-f1df2c0a-4f7a-4e67-9c15-f5268922f44b req-9d10096d-f37d-413d-b33f-c5ac4c4d5e00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083537 Nov 03 02:12:56.867055 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 614/1241] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:12:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:12:57.587439 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:57.588043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:57.594184 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:57.594629 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:57.595389 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:57.595816 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:57.725381 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:57.732980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4bb3fdcf-de79-4a24-801a-206502045592 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1361 microversion: 2.1 time: 0.149149 Nov 03 02:12:57.733524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 628/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:57 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:58.749762 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:58.750494 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:58.756504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:58.756956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:58.757732 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:58.758197 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:58.885324 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:12:58.893192 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1a100a8a-7221-420f-9432-7f0aabcec8f2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1547 microversion: 2.1 time: 0.148146 Nov 03 02:12:58.893761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 615/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:12:58 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:12:58.909037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:12:58.909557 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:12:58.915573 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:58.916015 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:58.916773 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:12:58.917721 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:12:58.993166 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9aed96e3-2c5e-45d0-825e-a14994336bf1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087704 Nov 03 02:12:58.993749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 629/1244] 10.222.0.30 () {58 vars in 1274 bytes} [Wed Nov 3 02:12:58 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:13:00.221262 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:00.222320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:00.223301 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-5f1c0398-9b8f-4b31-af1c-389c9c8f0db1 req-43ccab8b-f5cc-4582-bec5-3ac596bd1d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a425aa4c-e486-46d1-a3b2-6c4bf5c5359f", "tag": "4b5862d0-8505-44dd-bc82-5652650c09b5"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:00.224849 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:13:00.224849 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:13:00.228912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:00.229512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:00.230454 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:00.230966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:00.232737 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-5f1c0398-9b8f-4b31-af1c-389c9c8f0db1 req-43ccab8b-f5cc-4582-bec5-3ac596bd1d10 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:00.233183 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-5f1c0398-9b8f-4b31-af1c-389c9c8f0db1 req-43ccab8b-f5cc-4582-bec5-3ac596bd1d10 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:00.244394 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-5f1c0398-9b8f-4b31-af1c-389c9c8f0db1 req-43ccab8b-f5cc-4582-bec5-3ac596bd1d10 service nova] Creating event network-changed:4b5862d0-8505-44dd-bc82-5652650c09b5 for instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f on hv-cinder-81561 Nov 03 02:13:00.250411 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-5f1c0398-9b8f-4b31-af1c-389c9c8f0db1 req-43ccab8b-f5cc-4582-bec5-3ac596bd1d10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030461 Nov 03 02:13:00.251633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 630/1245] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:13:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:13:00.292530 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9e98ccf6-a898-4f18-95c2-adf87a3b3452 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.075020 Nov 03 02:13:00.297348 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 616/1246] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:00 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:01.305289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:01.306304 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:01.312530 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:01.313250 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:01.314038 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:01.314492 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:01.373363 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-25933d02-c1b5-470c-a2e4-a6a748ea9104 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.072525 Nov 03 02:13:01.373981 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 631/1247] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:01 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:02.384703 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:02.385672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:02.392490 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:02.392935 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:02.393699 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:02.394149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:02.450708 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-2aae9e1d-9554-44fb-800c-6ac974b02dab tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.069988 Nov 03 02:13:02.451302 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 617/1248] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:02 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:03.461859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:03.462841 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:03.469575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:03.470019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:03.470810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:03.471245 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:03.527995 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-48c06ec4-7770-48e4-8f8e-38b36efab733 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.070064 Nov 03 02:13:03.528606 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 632/1249] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:03 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:04.539610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:04.540622 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:04.548369 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:04.548747 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:04.549796 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:04.550259 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:04.614220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-990727a7-29e0-4918-a4aa-e821f0a46e3e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.078393 Nov 03 02:13:04.614771 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 618/1250] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:04 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:05.625047 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:05.626050 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:05.632918 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:05.633366 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:05.634153 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:05.634601 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:05.691536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2faa35ca-6537-46e2-aea4-9df1011187da tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.070395 Nov 03 02:13:05.692160 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 633/1251] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:05 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:06.702928 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:06.703941 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:06.710748 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:06.711200 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:06.711977 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:06.712417 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:06.768053 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-1e458dbc-9bf3-4046-87b8-464e2ee7b5a0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.069061 Nov 03 02:13:06.768711 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 619/1252] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:06 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:07.780386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:07.781413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:07.788154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:07.788598 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:07.789370 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:07.789800 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:07.846214 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-e3c81c74-d7fc-411c-8e26-e00515e334ff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.070213 Nov 03 02:13:07.846750 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 634/1253] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:07 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:08.856876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:08.857791 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:08.864539 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:08.864983 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:08.865742 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:08.866198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:08.922554 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-51654a1e-d130-4e38-84ed-d9eff37e0c41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.069618 Nov 03 02:13:08.923135 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 620/1254] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:08 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:09.933807 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:09.934861 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:09.941647 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:09.942182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:09.942959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:09.943422 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:09.999691 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2610ad43-e072-4e9a-a81e-02a18c1200b6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 14 microversion: 2.1 time: 0.070337 Nov 03 02:13:10.000457 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 635/1255] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:09 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:13:11.010617 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:11.011636 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:11.018446 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:11.018891 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:11.019653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:11.020084 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:11.089906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6553f4e4-fc42-45c9-8789-44c1a9b16ab3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 13379 microversion: 2.1 time: 0.083213 Nov 03 02:13:11.090550 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 621/1256] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:11 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 13379 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:12.101327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:12.102405 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:12.109974 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:12.110447 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:12.111244 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:12.113051 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:12.181526 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-141574f8-659c-4f79-abb7-de9276d66f41 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 18356 microversion: 2.1 time: 0.084115 Nov 03 02:13:12.182274 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 636/1257] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:12 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 18356 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:13.193241 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:13.194276 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:13.201101 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:13.201548 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:13.202354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:13.202790 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:13.276661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b00c1829-a06e-4e8a-bc76-45e3372196a8 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 19342 microversion: 2.1 time: 0.087328 Nov 03 02:13:13.277272 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 622/1258] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:13 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 19342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:14.288786 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:14.289779 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:14.297067 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:14.297504 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:14.298307 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:14.298990 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:14.368748 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1a3f063e-d62c-4a80-a6d2-bfa2f6c6eb87 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 21972 microversion: 2.1 time: 0.084147 Nov 03 02:13:14.369407 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 637/1259] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:14 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 21972 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:15.381597 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:15.382704 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:15.390314 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:15.390771 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:15.391582 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:15.392020 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:15.462547 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d3e69e57-42eb-4bca-b05a-01ed72d22ee5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 23235 microversion: 2.1 time: 0.086112 Nov 03 02:13:15.463186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 623/1260] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:15 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 23235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:16.474589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:16.475589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:16.482875 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:16.483328 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:16.484096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:16.484531 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:18.969894 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b958cdaa-d9dd-43d0-bcf9-faf45c4dbaf5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 27531 microversion: 2.1 time: 2.499195 Nov 03 02:13:18.970901 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 638/1261] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:16 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 27531 bytes in 2501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:19.981810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:19.982881 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:19.989683 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:19.990147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:19.990937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:19.991376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:20.065354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0e976ba7-e4ae-4508-a7ad-ba9173853e8a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28024 microversion: 2.1 time: 0.087471 Nov 03 02:13:20.066017 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 624/1262] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:19 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28024 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:21.077561 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:21.078602 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:21.086011 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:21.086478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:21.087249 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:21.087680 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:21.166539 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c2cf8a1a-7a84-45a0-939a-c60327519046 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28193 microversion: 2.1 time: 0.092999 Nov 03 02:13:21.167159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 639/1263] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:21 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:22.179318 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:22.180317 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:22.187643 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:22.188088 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:22.188849 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:22.189278 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:22.252997 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3eef7855-1374-4b6e-b0fe-030d9bb7f83b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28193 microversion: 2.1 time: 0.077529 Nov 03 02:13:22.253631 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 625/1264] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:22 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:23.265469 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:23.266487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:23.273223 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:23.273667 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:23.274466 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:23.274896 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:23.358413 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ef1cdb92-8805-41ba-a4bd-ac25b8efec21 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28484 microversion: 2.1 time: 0.097398 Nov 03 02:13:23.359019 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 640/1265] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:23 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28484 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:23.907680 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-205959345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1143971476", "security_groups": [{"name": "tempest-secgroup-smoke-2008507579"}], "block_device_mapping_v2": [{"uuid": "0682b6c0-e54f-45fd-b923-e0eaa6e93fdf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f712cad4-e8ca-42ec-98fb-45f5bacc0fc1"}]}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:24.021444 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.network.neutron [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] validate_networks() for [('f712cad4-e8ca-42ec-98fb-45f5bacc0fc1', None, None, None, None, None)] {{(pid=123011) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 03 02:13:24.370401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:24.371448 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:24.378228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:24.378761 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:24.379542 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:24.379970 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:24.397424 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Flavor limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 02:13:24.397845 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Image limits 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 02:13:24.398341 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Flavor pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 02:13:24.398745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Image pref 0:0:0 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 02:13:24.399149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.virt.hardware [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 02:13:24.408282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:24.408725 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:24.409591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:24.410019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:24.426531 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for project a08b0f1fc6b940148531ae61a6847288. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 03 02:13:24.430315 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.quota [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Getting quotas for user a9d618d410254d658124e5ee5ae46df2 and project a08b0f1fc6b940148531ae61a6847288. Resources: {'instances', 'ram', 'cores'} {{(pid=123011) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 03 02:13:24.441860 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-70d68344-59aa-4719-88b5-62dec3045ba6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28484 microversion: 2.1 time: 0.075390 Nov 03 02:13:24.445774 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 641/1266] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:24 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28484 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:13:24.484343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Going to run 1 instances... {{(pid=123011) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 03 02:13:24.486558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0682b6c0-e54f-45fd-b923-e0eaa6e93fdf',volume_size=None,volume_type=None)] {{(pid=123011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 03 02:13:24.967854 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b3f4c75c-8878-441b-9519-326bc7289b01 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.064183 Nov 03 02:13:24.968667 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 626/1267] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Nov 3 02:13:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 02:13:24.978854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-224ad818-b9f0-4598-aab0-64b11927959d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:24.979470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-224ad818-b9f0-4598-aab0-64b11927959d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:25.035410 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-224ad818-b9f0-4598-aab0-64b11927959d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:25.041785 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-224ad818-b9f0-4598-aab0-64b11927959d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1094 microversion: 2.1 time: 0.067004 Nov 03 02:13:25.042396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 642/1268] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:24 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:25.452850 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:25.453904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:25.460224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:25.460674 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:25.461449 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:25.461883 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:25.536157 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4d5d7832-e164-49eb-bd7e-a07ab41c13fb tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28651 microversion: 2.1 time: 0.086988 Nov 03 02:13:25.541404 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 627/1269] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:25 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28651 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:26.066700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:26.067305 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:26.073799 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:26.074884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:26.075664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:26.076098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:26.134352 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:26.142623 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a18d8606-b41f-4a9e-b90a-add33736600e tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1136 microversion: 2.1 time: 0.079675 Nov 03 02:13:26.143175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 643/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:26 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1136 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:26.548231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:26.549533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:26.556415 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:26.556902 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:26.557688 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:26.558122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:26.619673 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a347bdf2-3222-4be1-aac7-82c30b3fc700 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28651 microversion: 2.1 time: 0.075390 Nov 03 02:13:26.620596 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 628/1271] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:26 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:27.160835 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:27.161443 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:27.167780 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:27.170899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:27.170899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:27.170899 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:27.249688 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:27.256859 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-2db9a8cf-e3df-4beb-9de5-fb0917d2ab96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1210 microversion: 2.1 time: 0.099808 Nov 03 02:13:27.257612 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 644/1272] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:27 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:27.633876 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:27.634973 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:27.642668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:27.643265 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:27.644092 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:27.644527 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:27.708767 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-4d05de7c-99ea-4e2f-8ffd-5c379f9ce7f1 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 28651 microversion: 2.1 time: 0.080461 Nov 03 02:13:27.715660 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 629/1273] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:27 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 28651 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:28.274707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:28.275311 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:28.282031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:28.282535 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:28.283374 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:28.283759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:28.435716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:28.442917 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-46e7918e-2c45-4455-8cfa-f635dfdfe18d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.171863 Nov 03 02:13:28.443480 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 645/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:28 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:28.491591 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-a5a4aec3-18dc-42a5-a6ac-bd311cece53e req-3b1f2714-ad72-42e3-8314-dbef8e56e6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e224262-fe47-4306-9c1b-75a8a4b3879d", "tag": "5ddbb72e-a939-491e-b23a-62e5f93e3002"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:28.493166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:13:28.493166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:13:28.504728 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-a5a4aec3-18dc-42a5-a6ac-bd311cece53e req-3b1f2714-ad72-42e3-8314-dbef8e56e6f2 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:28.504728 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-a5a4aec3-18dc-42a5-a6ac-bd311cece53e req-3b1f2714-ad72-42e3-8314-dbef8e56e6f2 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:28.513984 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-a5a4aec3-18dc-42a5-a6ac-bd311cece53e req-3b1f2714-ad72-42e3-8314-dbef8e56e6f2 service nova] Creating event network-changed:5ddbb72e-a939-491e-b23a-62e5f93e3002 for instance 6e224262-fe47-4306-9c1b-75a8a4b3879d on hv-cinder-81561 Nov 03 02:13:28.518831 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-a5a4aec3-18dc-42a5-a6ac-bd311cece53e req-3b1f2714-ad72-42e3-8314-dbef8e56e6f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038934 Nov 03 02:13:28.519501 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 630/1275] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:13:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:13:28.720829 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:28.721822 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:28.727925 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:28.728470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:28.729306 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:28.729737 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:28.803237 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-21feeb47-3892-4724-9c6b-33ad2a059df3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 29771 microversion: 2.1 time: 0.086200 Nov 03 02:13:28.803954 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 646/1276] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:28 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 29771 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:29.466066 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:29.466778 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:29.472802 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:29.473261 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:29.474022 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:29.474482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:29.608793 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:29.615981 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c0a0b93a-4d9e-4667-a615-3691a23f0ac4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.154953 Nov 03 02:13:29.616544 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 631/1277] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:29 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:29.815633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:29.816524 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:29.823203 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:29.823641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:29.824905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:29.825329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:29.898979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-cd0f17c7-16c8-4c75-aba2-3ac3e30191b4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 31613 microversion: 2.1 time: 0.087312 Nov 03 02:13:29.899670 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 647/1278] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:29 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 31613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:30.632410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:30.633051 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:30.639346 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:30.639795 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:30.640570 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:30.641001 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:30.769087 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:30.776306 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-70a12405-3992-4da8-aab3-0f63b91e1825 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.147611 Nov 03 02:13:30.776872 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 632/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:30 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:30.911391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:30.912408 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:30.919684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:30.920121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:30.920884 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:30.921307 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:30.991368 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0819106a-bf56-4eaa-b243-0a6ca5114e8f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 33259 microversion: 2.1 time: 0.083763 Nov 03 02:13:30.991977 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 648/1280] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:30 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 33259 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:31.793258 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:31.793869 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:31.800363 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:31.800810 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:31.801580 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:31.802019 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:31.936269 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:31.943396 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-6a78e2ae-6c6f-4f77-924d-7f7b94aae802 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.153785 Nov 03 02:13:31.943964 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 633/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:31 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:32.003554 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:32.004556 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:32.011297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:32.011745 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:32.012521 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:32.012948 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:32.087423 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-43ca86c9-7622-4e03-9841-e7d3c5e8016f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 34351 microversion: 2.1 time: 0.087619 Nov 03 02:13:32.088078 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 649/1282] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:31 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 34351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:13:32.959717 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:32.960317 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:32.967367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:32.967819 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:32.968621 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:32.969060 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:33.099762 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:33.101618 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:33.104310 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:33.109227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:33.109947 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:33.111113 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:33.111715 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:33.111884 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a55c4704-50f2-4d69-a92f-1f0679446f44 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.155762 Nov 03 02:13:33.121574 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 634/1283] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:32 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:33.193552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3fb6d493-54cd-46f0-b09b-c50499f3475a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 35215 microversion: 2.1 time: 0.097558 Nov 03 02:13:33.194488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 650/1284] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:33 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 35215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:34.128954 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:34.129556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:34.135772 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:34.136213 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:34.137482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:34.137951 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:34.205734 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:34.206810 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:34.213608 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:34.214059 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:34.215555 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:34.215985 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:34.269912 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:34.277721 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7130bd60-aa5e-49da-971d-9242ffb3abb5 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.151836 Nov 03 02:13:34.278322 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 635/1285] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:34 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:34.285904 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-16a9afab-f8cd-4208-b2f1-80f326fe004b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 36599 microversion: 2.1 time: 0.084016 Nov 03 02:13:34.286783 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 651/1286] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:34 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 36599 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:13:35.294853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:35.295455 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:35.298759 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:35.299754 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:35.302115 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:35.302966 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:35.303354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:35.303780 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:35.306514 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:35.306975 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:35.307735 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:35.308159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:35.381376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f9d657db-e1b5-481d-ad94-bc6e43e86587 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 38074 microversion: 2.1 time: 0.085746 Nov 03 02:13:35.381376 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 652/1287] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:35 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 38074 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 02:13:35.433490 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:35.440834 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b07113b9-d886-4830-8b18-15a0cbcc803c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.150282 Nov 03 02:13:35.444090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 636/1288] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:35 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:36.393181 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:36.394226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:36.400892 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:36.401326 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:36.402080 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:36.402529 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:36.456533 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:36.457173 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:36.463471 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:36.463919 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:36.464779 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:36.465196 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:36.476042 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-ea96f5e3-efe7-4c51-945d-99b181c8939e tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 38180 microversion: 2.1 time: 0.086673 Nov 03 02:13:36.476704 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 653/1289] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:36 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 38180 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:36.599593 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:36.607343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0705d9eb-e47f-48d7-b130-9ef41ba90969 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.154508 Nov 03 02:13:36.607901 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 637/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:36 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:37.489213 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:37.490231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:37.497883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:37.498377 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:37.499121 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:37.499546 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:37.560996 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-b1746c15-d73e-4e75-b293-755adc4e7a2b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 38180 microversion: 2.1 time: 0.075613 Nov 03 02:13:37.562854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 654/1291] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:37 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 38180 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:37.624313 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:37.624925 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:37.631207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:37.631661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:37.632438 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:37.632908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:37.760147 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:37.767860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-3939feec-a6b7-495b-90dd-39c966d22d49 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.147748 Nov 03 02:13:37.768422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 638/1292] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:37 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:38.573070 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:38.574154 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:38.580980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:38.581423 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:38.582219 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:38.582657 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:38.642585 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0af67459-2b9c-4113-99e8-85403d6f7899 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 38180 microversion: 2.1 time: 0.073421 Nov 03 02:13:38.643206 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 655/1293] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:38 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 38180 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:38.784330 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:38.785011 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:38.791118 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:38.791558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:38.792320 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:38.792747 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:38.922580 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:38.930186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-80bc9fd7-c353-47fd-9213-28384abfaaa0 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.149448 Nov 03 02:13:38.930760 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 639/1294] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:38 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:38.974904 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-44686226-dcbf-4afe-a754-8c136da07852 req-7371c3d5-1d6a-49eb-a2d1-dd79334ab4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e224262-fe47-4306-9c1b-75a8a4b3879d", "name": "network-vif-plugged", "status": "completed", "tag": "5ddbb72e-a939-491e-b23a-62e5f93e3002"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:38.977642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:13:38.977642 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:13:38.984098 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-44686226-dcbf-4afe-a754-8c136da07852 req-7371c3d5-1d6a-49eb-a2d1-dd79334ab4c8 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:38.984544 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-44686226-dcbf-4afe-a754-8c136da07852 req-7371c3d5-1d6a-49eb-a2d1-dd79334ab4c8 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:38.995030 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-44686226-dcbf-4afe-a754-8c136da07852 req-7371c3d5-1d6a-49eb-a2d1-dd79334ab4c8 service nova] Creating event network-vif-plugged:5ddbb72e-a939-491e-b23a-62e5f93e3002 for instance 6e224262-fe47-4306-9c1b-75a8a4b3879d on hv-cinder-81561 Nov 03 02:13:39.000234 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-44686226-dcbf-4afe-a754-8c136da07852 req-7371c3d5-1d6a-49eb-a2d1-dd79334ab4c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029357 Nov 03 02:13:39.006294 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 656/1295] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:13:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:13:39.653668 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:39.654568 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:39.660350 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:39.660795 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:39.661556 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:39.661988 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:39.742093 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-03201068-834d-4d86-b59d-b410893610bf tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 38256 microversion: 2.1 time: 0.091993 Nov 03 02:13:39.742786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 640/1296] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:39 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 38256 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:39.947795 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:39.948412 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:39.954474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:39.954924 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:39.955687 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:39.956118 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:40.086079 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:40.093751 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-58121d70-de71-48aa-a29e-4f572c56320f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1266 microversion: 2.1 time: 0.150479 Nov 03 02:13:40.094335 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 657/1297] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:39 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:40.754193 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:40.755201 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:40.764129 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:40.764576 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:40.765343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:40.765776 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:40.834786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-aaf1ea22-e0cb-4877-8a4f-f3d1727f0ba2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action" status: 200 len: 38309 microversion: 2.1 time: 0.084429 Nov 03 02:13:40.835326 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 641/1298] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 3 02:13:40 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/action => generated 38309 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 02:13:40.844825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:40.845319 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:40.851488 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:40.851932 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:40.852702 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:40.853134 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:40.876263 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1b0fe838-2ba1-470a-a92b-343b9ee5a616 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/ips" status: 200 len: 145 microversion: 2.1 time: 0.035045 Nov 03 02:13:40.876809 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 658/1299] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Nov 3 02:13:40 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:13:41.111123 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:41.111856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:41.118661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:41.119112 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:41.119887 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:41.120321 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:41.256330 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:41.263606 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-08725c65-5419-493b-99bc-efb4ffe77358 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1453 microversion: 2.1 time: 0.156658 Nov 03 02:13:41.264163 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 642/1300] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:41 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:13:41.279749 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:41.285882 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:41.286589 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:41.287037 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:41.287856 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:41.288278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:41.428116 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:13:41.432246 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-6b8bee0f-19e4-42ca-8e8f-c2fc1d992a96 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1453 microversion: 2.1 time: 0.156567 Nov 03 02:13:41.432928 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 659/1301] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:13:41 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:13:42.452745 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cd9ec25-f347-4d11-b8ae-e619aebd3eae"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:42.453973 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:42.460122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:42.460573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:42.461358 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:42.461797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:43.180390 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9ce9e5b9-cc44-480d-a056-22442f6c774c tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731153 Nov 03 02:13:43.181100 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 643/1302] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:13:42 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:13:43.632905 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-f26716d7-eedd-46ae-98b8-a48af941c407 req-cdb3edf2-7e82-4ce4-a43c-416ffa6a5843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e224262-fe47-4306-9c1b-75a8a4b3879d", "tag": "5ddbb72e-a939-491e-b23a-62e5f93e3002"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:43.635028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:13:43.635028 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:13:43.642739 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-f26716d7-eedd-46ae-98b8-a48af941c407 req-cdb3edf2-7e82-4ce4-a43c-416ffa6a5843 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:43.646273 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-f26716d7-eedd-46ae-98b8-a48af941c407 req-cdb3edf2-7e82-4ce4-a43c-416ffa6a5843 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:43.654558 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-f26716d7-eedd-46ae-98b8-a48af941c407 req-cdb3edf2-7e82-4ce4-a43c-416ffa6a5843 service nova] Creating event network-changed:5ddbb72e-a939-491e-b23a-62e5f93e3002 for instance 6e224262-fe47-4306-9c1b-75a8a4b3879d on hv-cinder-81561 Nov 03 02:13:43.659338 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-f26716d7-eedd-46ae-98b8-a48af941c407 req-cdb3edf2-7e82-4ce4-a43c-416ffa6a5843 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030034 Nov 03 02:13:43.659916 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 660/1303] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:13:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:13:50.629498 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:50.630514 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:50.636454 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:50.636904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:50.637676 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:50.638108 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:50.665702 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d34b8110-937e-4d25-8f45-69b9cdede0e5 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040831 Nov 03 02:13:50.666273 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 644/1304] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:13:50 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:13:50.677372 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:13:50.677943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:50.684431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:50.684873 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:50.685636 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:50.686064 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:50.712633 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0043e69a-8810-4469-8cfc-d94beed0a3c2 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/3cd9ec25-f347-4d11-b8ae-e619aebd3eae" status: 200 len: 194 microversion: 2.1 time: 0.040032 Nov 03 02:13:50.713174 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 661/1305] 10.222.0.30 () {58 vars in 1412 bytes} [Wed Nov 3 02:13:50 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/3cd9ec25-f347-4d11-b8ae-e619aebd3eae => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 02:13:52.277562 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ff4bbda-28fc-4b15-aca6-7a03ef367fae"}} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:13:52.278652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:13:52.284856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:52.285307 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:52.286072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:13:52.286534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:13:53.018937 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-5ee1624a-18f5-4c4c-a73c-52ed8e5fa9f6 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744920 Nov 03 02:13:53.019552 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 645/1306] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Nov 3 02:13:52 2021] POST /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:14:00.471297 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:00.472214 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:00.478440 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:00.478891 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:00.479664 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:00.480097 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:00.509641 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-977afc0c-bccc-4107-817e-a7f10a558da0 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042189 Nov 03 02:14:00.510700 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 662/1307] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:14:00 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:14:00.710797 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:00.711376 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:00.718010 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:00.718483 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:00.719250 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:00.719709 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:00.748311 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b4384bf0-536b-4695-a194-a8bde673adff tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/3cd9ec25-f347-4d11-b8ae-e619aebd3eae" status: 200 len: 194 microversion: 2.1 time: 0.042154 Nov 03 02:14:00.748883 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 646/1308] 10.222.0.30 () {58 vars in 1412 bytes} [Wed Nov 3 02:14:00 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/3cd9ec25-f347-4d11-b8ae-e619aebd3eae => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:14:00.758144 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:00.758655 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:00.764348 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:00.764798 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:00.765570 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:00.766006 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:00.841836 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lazy-loading 'services' on Instance uuid a425aa4c-e486-46d1-a3b2-6c4bf5c5359f {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:14:01.106621 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-27a8f94c-c263-4976-afdf-5d4c91523ddc tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/3cd9ec25-f347-4d11-b8ae-e619aebd3eae" status: 202 len: 0 microversion: 2.1 time: 0.351936 Nov 03 02:14:01.107231 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 663/1309] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:14:00 2021] DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/3cd9ec25-f347-4d11-b8ae-e619aebd3eae => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:14:03.260629 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:03.261150 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:03.267799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:03.268244 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:03.269015 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:03.269456 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:03.297555 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-a413204e-2d4b-4c04-b160-c8aea528cc3f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/6ff4bbda-28fc-4b15-aca6-7a03ef367fae" status: 200 len: 194 microversion: 2.1 time: 0.040392 Nov 03 02:14:03.298117 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 647/1310] 10.222.0.30 () {58 vars in 1412 bytes} [Wed Nov 3 02:14:03 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/6ff4bbda-28fc-4b15-aca6-7a03ef367fae => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:14:03.308422 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:03.308993 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:03.314913 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:03.315355 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:03.316109 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:03.316536 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:03.392228 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lazy-loading 'services' on Instance uuid a425aa4c-e486-46d1-a3b2-6c4bf5c5359f {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:14:03.598270 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a47fb205-c66c-45b9-a68b-6e4f295e8123 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/6ff4bbda-28fc-4b15-aca6-7a03ef367fae" status: 202 len: 0 microversion: 2.1 time: 0.294250 Nov 03 02:14:03.598852 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 664/1311] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Nov 3 02:14:03 2021] DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments/6ff4bbda-28fc-4b15-aca6-7a03ef367fae => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:14:04.745367 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:04.746368 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:04.752813 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:04.753288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:04.754039 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:04.754504 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:04.783408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8e968ea3-f52e-4fcc-97fa-4797a9cf4f91 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041761 Nov 03 02:14:04.783897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 648/1312] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:14:04 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:14:04.880341 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:04.881401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:04.887279 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:04.887718 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:04.888474 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:04.888897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:04.916975 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-acd1e7b9-65a1-4302-a5d4-857e5a7558e4 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041105 Nov 03 02:14:04.917511 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 665/1313] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Nov 3 02:14:04 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 02:14:04.971727 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:04.972218 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:04.977789 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:04.978264 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:04.979026 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:04.979452 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:05.002492 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:14:05.301194 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-9018219a-a52b-40b0-b566-c5044d9e8c60 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 204 len: 0 microversion: 2.1 time: 0.333318 Nov 03 02:14:05.301786 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 649/1314] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:14:04 2021] DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:14:05.309646 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:05.317553 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:05.317553 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:05.317553 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:05.317888 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:05.318159 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:05.447606 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:14:05.455617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-0f081726-39ac-4817-9247-4e06db8554fd tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1671 microversion: 2.1 time: 0.149614 Nov 03 02:14:05.456182 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 666/1315] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:05 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:14:06.474223 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:06.475002 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:06.481410 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:06.481875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:06.482691 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:06.483207 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:06.632481 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:14:06.640908 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-8d0edfdf-d403-4903-b2d9-d786426bcd7a tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1671 microversion: 2.1 time: 0.171215 Nov 03 02:14:06.641534 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 650/1316] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:06 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:14:07.658096 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:07.658805 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:07.665176 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:07.665617 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:07.666401 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:07.666825 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:07.839461 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:14:07.853061 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c8d35387-304e-497c-a030-e7aeea809f0d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1671 microversion: 2.1 time: 0.199201 Nov 03 02:14:07.853744 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 667/1317] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:07 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:14:08.114693 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-5fdbcfec-7392-4f19-bc9e-e94b6aafd3b7 req-a5ac0f6a-8361-4c7b-a491-31afb27f443e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a425aa4c-e486-46d1-a3b2-6c4bf5c5359f", "name": "network-vif-deleted", "tag": "4b5862d0-8505-44dd-bc82-5652650c09b5"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:14:08.116224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:14:08.116224 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:14:08.123447 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-5fdbcfec-7392-4f19-bc9e-e94b6aafd3b7 req-a5ac0f6a-8361-4c7b-a491-31afb27f443e service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:08.124512 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-5fdbcfec-7392-4f19-bc9e-e94b6aafd3b7 req-a5ac0f6a-8361-4c7b-a491-31afb27f443e service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:08.135597 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-5fdbcfec-7392-4f19-bc9e-e94b6aafd3b7 req-a5ac0f6a-8361-4c7b-a491-31afb27f443e service nova] Creating event network-vif-deleted:4b5862d0-8505-44dd-bc82-5652650c09b5 for instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f on hv-cinder-81561 Nov 03 02:14:08.140489 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-5fdbcfec-7392-4f19-bc9e-e94b6aafd3b7 req-a5ac0f6a-8361-4c7b-a491-31afb27f443e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029545 Nov 03 02:14:08.141090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 651/1318] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:14:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:14:08.870256 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:08.870867 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:08.877269 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:08.877708 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:08.878520 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:08.878945 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:08.910685 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:08.911049 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:08.911501 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lazy-loading 'fault' on Instance uuid a425aa4c-e486-46d1-a3b2-6c4bf5c5359f {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:14:08.953740 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd4afe870ee4c5e88b2fc94035eb855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd183c43fe64f528cb1a54e0e951443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:14:08.961400 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-f349a311-d251-42bb-b4c8-fe78f6f9c09b tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 200 len: 1326 microversion: 2.1 time: 0.094746 Nov 03 02:14:08.962005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 668/1319] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:08 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:14:09.979638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:09.980360 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:09.987003 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:09.987454 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:09.988220 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:09.988672 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:10.001422 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] HTTP exception thrown: Instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f could not be found. Nov 03 02:14:10.001994 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Returning 404 to user: Instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:14:10.002826 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-74a76d0c-d3c1-41f9-ab30-8cb1acc12e38 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 404 len: 111 microversion: 2.1 time: 0.027663 Nov 03 02:14:10.003343 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 652/1320] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:09 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:14:10.011431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d3694279-1f08-4ce7-95db-23d93d28401f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '.version_select at 0x7f30b7c0af70>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:10.102330 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d3694279-1f08-4ce7-95db-23d93d28401f tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-127150931" status: 202 len: 0 microversion: 2.1 time: 0.094458 Nov 03 02:14:10.102897 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 669/1321] 10.222.0.30 () {58 vars in 1217 bytes} [Wed Nov 3 02:14:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-127150931 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:14:13.411896 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:13.412394 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:13.418636 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:13.419090 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:13.419867 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:13.420558 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:13.433579 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] HTTP exception thrown: Instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f could not be found. Nov 03 02:14:13.434182 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Returning 404 to user: Instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:14:13.434976 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-d3b0afb9-9dd8-4fb6-9188-3f3cf9237870 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 404 len: 111 microversion: 2.1 time: 0.026735 Nov 03 02:14:13.435484 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 653/1322] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:14:13 2021] DELETE /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:14:13.444145 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:13.444747 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: a425aa4c-e486-46d1-a3b2-6c4bf5c5359f] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:13.451177 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:13.452279 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:13.453043 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:13.453470 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:13.465714 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] HTTP exception thrown: Instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f could not be found. Nov 03 02:14:13.466316 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Returning 404 to user: Instance a425aa4c-e486-46d1-a3b2-6c4bf5c5359f could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:14:13.467227 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-4f92741c-5734-4563-a762-c74f60aee6e3 tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f" status: 404 len: 111 microversion: 2.1 time: 0.027316 Nov 03 02:14:13.467728 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 670/1323] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:13 2021] GET /compute/v2.1/servers/a425aa4c-e486-46d1-a3b2-6c4bf5c5359f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:14:14.767860 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:14.768354 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:14.774464 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:14.774914 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:14.775686 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:14.776122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:14.789434 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] HTTP exception thrown: Instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 could not be found. Nov 03 02:14:14.789999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Returning 404 to user: Instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:14:14.790824 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-fb223fbe-666a-4a3d-ab43-80174b621cbe tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 404 len: 111 microversion: 2.1 time: 0.027192 Nov 03 02:14:14.791333 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 654/1324] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:14:14 2021] DELETE /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:14:14.798991 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:14:14.799587 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] [instance: c9f31bdf-2f02-4be5-b437-7e26dcceb512] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:14:14.805634 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:14.806074 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:14.806978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:14:14.807406 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:14:14.819854 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] HTTP exception thrown: Instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 could not be found. Nov 03 02:14:14.820361 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] Returning 404 to user: Instance c9f31bdf-2f02-4be5-b437-7e26dcceb512 could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:14:14.821139 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-992b4e1f-ee9e-4091-a40a-3ab64e48219d tempest-AttachVolumeTestJSON-1162721369 tempest-AttachVolumeTestJSON-1162721369-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512" status: 404 len: 111 microversion: 2.1 time: 0.026066 Nov 03 02:14:14.821644 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 671/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:14:14 2021] GET /compute/v2.1/servers/c9f31bdf-2f02-4be5-b437-7e26dcceb512 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:15:11.779040 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:11.780282 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:11.787142 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:11.787940 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:11.788962 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:11.789645 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:11.818116 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Going to try to terminate instance {{(pid=123011) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:15:11.953128 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-98c5e5ea-d008-44c7-a54d-0828141b14a4 req-711334ec-7d40-41e8-8ccc-46c8e77524f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e224262-fe47-4306-9c1b-75a8a4b3879d", "tag": "5ddbb72e-a939-491e-b23a-62e5f93e3002"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:15:11.954662 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:15:11.954662 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:15:11.961903 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-98c5e5ea-d008-44c7-a54d-0828141b14a4 req-711334ec-7d40-41e8-8ccc-46c8e77524f2 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:11.962396 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-98c5e5ea-d008-44c7-a54d-0828141b14a4 req-711334ec-7d40-41e8-8ccc-46c8e77524f2 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:11.982533 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-98c5e5ea-d008-44c7-a54d-0828141b14a4 req-711334ec-7d40-41e8-8ccc-46c8e77524f2 service nova] Creating event network-changed:5ddbb72e-a939-491e-b23a-62e5f93e3002 for instance 6e224262-fe47-4306-9c1b-75a8a4b3879d on hv-cinder-81561 Nov 03 02:15:11.987797 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-98c5e5ea-d008-44c7-a54d-0828141b14a4 req-711334ec-7d40-41e8-8ccc-46c8e77524f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216459 Nov 03 02:15:11.988807 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 672/1326] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:15:12.207827 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-537d606a-6203-4b7a-9e94-9c018e4d2216 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 204 len: 0 microversion: 2.1 time: 0.439000 Nov 03 02:15:12.208416 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 655/1327] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:15:11 2021] DELETE /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:15:12.221302 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:12.221995 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:12.228978 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:12.229431 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:12.230238 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:12.230679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:12.457172 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:12.465398 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-9634f818-e0e8-403d-bd46-1e44184fa5ea tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1578 microversion: 2.1 time: 0.250714 Nov 03 02:15:12.465973 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 673/1328] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:12 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1578 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:13.483186 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:13.483875 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:13.489803 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:13.490857 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:13.491638 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:13.492072 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:13.636334 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:13.643590 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-452b5da6-7dfa-4209-b634-508d66ddf844 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1459 microversion: 2.1 time: 0.164503 Nov 03 02:15:13.644149 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 656/1329] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:13 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1459 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:14.460575 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [req-410a9e88-4d3d-4f5d-957a-3f8f295c368f req-812d9674-8d86-40b1-b3c6-1778cb011a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e224262-fe47-4306-9c1b-75a8a4b3879d", "name": "network-vif-deleted", "tag": "5ddbb72e-a939-491e-b23a-62e5f93e3002"}]} {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:15:14.462158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:15:14.462158 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: warnings.warn(msg) Nov 03 02:15:14.469467 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-410a9e88-4d3d-4f5d-957a-3f8f295c368f req-812d9674-8d86-40b1-b3c6-1778cb011a09 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:14.476619 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [req-410a9e88-4d3d-4f5d-957a-3f8f295c368f req-812d9674-8d86-40b1-b3c6-1778cb011a09 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:14.480532 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.compute.server_external_events [req-410a9e88-4d3d-4f5d-957a-3f8f295c368f req-812d9674-8d86-40b1-b3c6-1778cb011a09 service nova] Creating event network-vif-deleted:5ddbb72e-a939-491e-b23a-62e5f93e3002 for instance 6e224262-fe47-4306-9c1b-75a8a4b3879d on hv-cinder-81561 Nov 03 02:15:14.485552 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [req-410a9e88-4d3d-4f5d-957a-3f8f295c368f req-812d9674-8d86-40b1-b3c6-1778cb011a09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028597 Nov 03 02:15:14.486114 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 674/1330] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:15:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:15:14.660389 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:14.661032 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:14.668122 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:14.668528 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:14.669298 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:14.669730 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:14.733281 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:14.741398 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-60945000-d437-44e0-9df9-e53fa235f433 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1225 microversion: 2.1 time: 0.084626 Nov 03 02:15:14.742145 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 657/1331] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:14 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:15.760417 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:15.761031 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:15.767578 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:15.774833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:15.774833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:15.774833 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:15.800237 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:15.800684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:15.801153 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lazy-loading 'fault' on Instance uuid 6e224262-fe47-4306-9c1b-75a8a4b3879d {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:15:15.841453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:15.848148 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-785c58cb-ada2-48a2-b178-d1b89d3f2fc6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 200 len: 1184 microversion: 2.1 time: 0.092541 Nov 03 02:15:15.848707 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 675/1332] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:15 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 1184 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:16.880615 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:16.881453 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 6e224262-fe47-4306-9c1b-75a8a4b3879d] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:16.887425 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:16.887877 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:16.888650 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:16.889083 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:16.902229 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] HTTP exception thrown: Instance 6e224262-fe47-4306-9c1b-75a8a4b3879d could not be found. Nov 03 02:15:16.902808 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Returning 404 to user: Instance 6e224262-fe47-4306-9c1b-75a8a4b3879d could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:15:16.903608 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-7ef4bf10-356a-4fb9-b155-bb0f9755ccdf tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d" status: 404 len: 111 microversion: 2.1 time: 0.026809 Nov 03 02:15:16.904127 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 658/1333] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:16 2021] GET /compute/v2.1/servers/6e224262-fe47-4306-9c1b-75a8a4b3879d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:15:20.186207 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:20.186791 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:20.188899 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-43518145-886f-4ca4-8320-2009db940783 req-652a012c-52c5-4717-bbd9-7fc79bd28ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7a5a05-f330-4efd-8bb2-d11ec928e3a2", "tag": "e4f46ead-c149-4eee-ac3c-12255a6be4f7"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:15:20.190546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:15:20.190546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:15:20.193249 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:20.193696 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:20.195084 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:20.195508 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:20.198689 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-43518145-886f-4ca4-8320-2009db940783 req-652a012c-52c5-4717-bbd9-7fc79bd28ba1 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:20.199136 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-43518145-886f-4ca4-8320-2009db940783 req-652a012c-52c5-4717-bbd9-7fc79bd28ba1 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:20.211712 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-43518145-886f-4ca4-8320-2009db940783 req-652a012c-52c5-4717-bbd9-7fc79bd28ba1 service nova] Creating event network-changed:e4f46ead-c149-4eee-ac3c-12255a6be4f7 for instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 on hv-cinder-81561 Nov 03 02:15:20.217014 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-43518145-886f-4ca4-8320-2009db940783 req-652a012c-52c5-4717-bbd9-7fc79bd28ba1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032489 Nov 03 02:15:20.218256 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 659/1334] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:15:20.223577 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Going to try to terminate instance {{(pid=123012) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 03 02:15:20.531912 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-c551b876-afcc-4d63-b409-18923c06af1c tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 204 len: 0 microversion: 2.1 time: 0.349566 Nov 03 02:15:20.532722 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 676/1335] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:15:20 2021] DELETE /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 02:15:20.542188 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:20.543562 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:20.550482 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:20.551198 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:20.552110 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:20.552618 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:20.776508 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:20.785897 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-c9a53bfa-a707-4fcb-bb13-b6e5ff39d5f8 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1578 microversion: 2.1 time: 0.248522 Nov 03 02:15:20.786610 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 660/1336] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:20 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1578 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:21.804243 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:21.804943 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:21.811071 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:21.811515 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:21.812289 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:21.812724 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:21.949936 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:21.957175 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-046d2ad8-6d68-4f6e-b0ff-85deda107e3d tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.157388 Nov 03 02:15:21.957760 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 677/1337] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:21 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:22.973904 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:22.974537 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:22.980743 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:22.985652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:22.985652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:22.985652 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:23.113799 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:23.121635 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b48eb913-f188-4eb1-8c41-19f955f6a4d1 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.151427 Nov 03 02:15:23.122228 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 661/1338] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:22 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:24.138391 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:24.138999 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:24.145150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:24.145591 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:24.146389 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:24.146819 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:24.277544 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:24.285149 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-a87a0ce9-0dbd-466b-b07f-645df7f09f90 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.150389 Nov 03 02:15:24.285706 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 678/1339] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:24 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:25.284463 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-aeb28c0c-4ba9-491a-8cb3-3b5a8fe78b35 req-2614bab8-e4ab-48b4-aac6-9cc44a8113ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7a5a05-f330-4efd-8bb2-d11ec928e3a2", "name": "network-vif-unplugged", "status": "completed", "tag": "e4f46ead-c149-4eee-ac3c-12255a6be4f7"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:15:25.285999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:15:25.285999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:15:25.293086 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-aeb28c0c-4ba9-491a-8cb3-3b5a8fe78b35 req-2614bab8-e4ab-48b4-aac6-9cc44a8113ec service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:25.293524 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-aeb28c0c-4ba9-491a-8cb3-3b5a8fe78b35 req-2614bab8-e4ab-48b4-aac6-9cc44a8113ec service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:25.301611 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:25.302346 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:25.304707 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-aeb28c0c-4ba9-491a-8cb3-3b5a8fe78b35 req-2614bab8-e4ab-48b4-aac6-9cc44a8113ec service nova] Creating event network-vif-unplugged:e4f46ead-c149-4eee-ac3c-12255a6be4f7 for instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 on hv-cinder-81561 Nov 03 02:15:25.309525 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-aeb28c0c-4ba9-491a-8cb3-3b5a8fe78b35 req-2614bab8-e4ab-48b4-aac6-9cc44a8113ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028719 Nov 03 02:15:25.309675 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:25.310166 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 662/1340] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:15:25.310340 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:25.311157 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:25.311703 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:25.448261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:25.455582 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-3fce3cda-3257-45f9-8614-df945bd8d4dd tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.157609 Nov 03 02:15:25.456150 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 679/1341] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:25 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 02:15:26.473573 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:26.474319 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:26.480926 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:26.481371 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:26.482159 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:26.482653 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:26.617231 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:26.624536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-b37e066f-5330-4d97-bab0-0a0482f67f89 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.155418 Nov 03 02:15:26.625094 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 663/1342] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:26 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:27.641632 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:27.642254 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:27.648487 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:27.648927 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:27.649679 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:27.650103 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:27.782029 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:27.790329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-962a1b2b-b2e7-4e7c-a95c-1f60288ed9d4 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.152313 Nov 03 02:15:27.790889 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 680/1343] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:27 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:28.807893 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:28.808436 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:28.814654 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:28.815097 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:28.815862 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:28.816290 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:28.944761 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.policy [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123011) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:28.951853 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-0358c4a5-20cb-4665-bd31-e3ce54b801a6 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.147707 Nov 03 02:15:28.952408 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 664/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:28 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:29.968005 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:29.968605 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:29.975288 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:29.976192 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:29.976579 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:29.977004 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:30.154473 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:30.155766 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-d29c0c58-b1f3-40bd-8b6d-2cc6fdd44215 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1459 microversion: 2.1 time: 0.191406 Nov 03 02:15:30.156327 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 681/1345] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:29 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1459 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:30.261391 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [req-df3156e5-191c-4832-8a5f-69fdc81c7be1 req-9f196f26-c128-4d99-9ff3-35053b0b0014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7a5a05-f330-4efd-8bb2-d11ec928e3a2", "name": "network-vif-deleted", "tag": "e4f46ead-c149-4eee-ac3c-12255a6be4f7"}]} {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 02:15:30.262906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 03 02:15:30.262906 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: warnings.warn(msg) Nov 03 02:15:30.269956 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-df3156e5-191c-4832-8a5f-69fdc81c7be1 req-9f196f26-c128-4d99-9ff3-35053b0b0014 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:30.270420 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [req-df3156e5-191c-4832-8a5f-69fdc81c7be1 req-9f196f26-c128-4d99-9ff3-35053b0b0014 service nova] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:30.281621 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.compute.server_external_events [req-df3156e5-191c-4832-8a5f-69fdc81c7be1 req-9f196f26-c128-4d99-9ff3-35053b0b0014 service nova] Creating event network-vif-deleted:e4f46ead-c149-4eee-ac3c-12255a6be4f7 for instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 on hv-cinder-81561 Nov 03 02:15:30.286702 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [req-df3156e5-191c-4832-8a5f-69fdc81c7be1 req-9f196f26-c128-4d99-9ff3-35053b0b0014 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028815 Nov 03 02:15:30.287873 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 665/1346] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 3 02:15:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 02:15:31.172775 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:31.173392 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:31.180278 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:31.180716 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:31.181478 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:31.181904 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:31.211437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:31.211883 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:31.212325 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.objects.instance [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lazy-loading 'fault' on Instance uuid 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 {{(pid=123012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 03 02:15:31.252088 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.policy [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d618d410254d658124e5ee5ae46df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08b0f1fc6b940148531ae61a6847288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123012) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 02:15:31.259329 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-08f220cd-e7cd-4460-94cc-5715f99f97e7 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 200 len: 1230 microversion: 2.1 time: 0.090456 Nov 03 02:15:31.259888 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 682/1347] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:31 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 02:15:32.277656 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:32.278369 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:32.284503 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:32.284947 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:32.285706 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:32.286152 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:32.298999 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] HTTP exception thrown: Instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 could not be found. Nov 03 02:15:32.299563 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Returning 404 to user: Instance 2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:15:32.300379 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f00c5651-7f27-411c-8f7a-f76992356cfe tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2" status: 404 len: 111 microversion: 2.1 time: 0.027830 Nov 03 02:15:32.300880 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 666/1348] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:32 2021] GET /compute/v2.1/servers/2c7a5a05-f330-4efd-8bb2-d11ec928e3a2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:15:32.806276 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:32.806794 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.compute.api [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123012) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:32.813188 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:32.813639 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:32.814494 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:32.815093 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG oslo_concurrency.lockutils [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:32.827980 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.wsgi [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] HTTP exception thrown: Instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea could not be found. Nov 03 02:15:32.828561 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Returning 404 to user: Instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea could not be found. {{(pid=123012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:15:32.829434 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-1d6c5859-8b98-4fd8-b748-35d6af12de14 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 404 len: 111 microversion: 2.1 time: 0.027478 Nov 03 02:15:32.829956 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 683/1349] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Nov 3 02:15:32 2021] DELETE /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:15:32.837959 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '>' {{(pid=123011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:32.838572 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.compute.api [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] [instance: e2ac3d5d-bfe6-4665-a05e-4e43603bdeea] Fetching instance by UUID {{(pid=123011) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 03 02:15:32.844288 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:32.848536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:32.848536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 03 02:15:32.848536 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG oslo_concurrency.lockutils [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Lock "f8df2cde-dfb3-4296-bec6-9291d21b17e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 03 02:15:32.859069 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.wsgi [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] HTTP exception thrown: Instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea could not be found. Nov 03 02:15:32.859661 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: DEBUG nova.api.openstack.wsgi [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Returning 404 to user: Instance e2ac3d5d-bfe6-4665-a05e-4e43603bdeea could not be found. {{(pid=123011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 03 02:15:32.860526 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO nova.api.openstack.requestlog [None req-f840cf92-ee17-439b-a218-e4bbbe024b3f tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea" status: 404 len: 111 microversion: 2.1 time: 0.026312 Nov 03 02:15:32.861029 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: [pid: 123011|app: 0|req: 667/1350] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Nov 3 02:15:32 2021] GET /compute/v2.1/servers/e2ac3d5d-bfe6-4665-a05e-4e43603bdeea => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 02:15:34.390735 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: DEBUG nova.api.openstack.wsgi [None req-459dcbf5-acb6-46c4-a1de-2aa442487f95 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] Calling method '.version_select at 0x7f30b7bbd820>' {{(pid=123012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 02:15:34.480872 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO nova.api.openstack.requestlog [None req-459dcbf5-acb6-46c4-a1de-2aa442487f95 tempest-TestVolumeBootPattern-523835539 tempest-TestVolumeBootPattern-523835539-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1143971476" status: 202 len: 0 microversion: 2.1 time: 0.094403 Nov 03 02:15:34.481386 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: [pid: 123012|app: 0|req: 684/1351] 10.222.0.30 () {58 vars in 1262 bytes} [Wed Nov 3 02:15:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1143971476 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 02:16:03.130679 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:16:03.131333 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: Wed Nov 3 02:16:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:16:52.654445 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:16:52.654979 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: Wed Nov 3 02:16:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:17:23.035959 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:17:23.041437 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: Wed Nov 3 02:17:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:18:35.616453 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:18:35.617046 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: Wed Nov 3 02:18:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:18:38.440950 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:18:38.441546 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: Wed Nov 3 02:18:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:19:23.148372 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:19:23.149054 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: Wed Nov 3 02:19:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:20:12.675684 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:20:12.676261 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: Wed Nov 3 02:20:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:20:40.776260 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:20:40.776856 dv-cinder-815614-3-iscsi devstack@n-api.service[123011]: Wed Nov 3 02:20:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 03 02:20:43.054650 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 02:20:43.055226 dv-cinder-815614-3-iscsi devstack@n-api.service[123012]: Wed Nov 3 02:20:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!